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A. Introduction 


This project seeks to validate the phases of Illness paradigm (POIP) (Pamplin 2011) and its effect on a variety 
of measures in three Burn ICUs. This paradigm describes patients with similar illness severity for which 
clinicians define standard goals of care, treatment objectives, and specific care tasks. Checklists may help to 
identify a patient's illness severity and priorities of care as they progress or regress through the continuum of 
illness during their time in the ICU. Within each “phase of illness” — or range of illness severity — phase-specific 
checklists may help ensure adherence to local protocols, best practices, clinical guidelines, and specific care 
bundles. These checklists may help to standardize supportive care elements such as types of monitoring, 
frequency and type of laboratory assessment, sedation strategies, modes of mechanical ventilation, and 
physical therapy interventions. Through this standardization, the POIP may create a shared mental model of 
patient care amongst clinicians in the BICU and thus enhance distributed cognition (Hutchins 2000) and assist 
the work of the multidisciplinary ICU care team. The objectives of this program are as follows: 


a. Understand the work domain in the Burn ICU in terms of patient condition, patient progress, and 
dependent clinician behaviors in order to create ecologically valid checklists that support clinician work 
including decision making according to the Phases of Illness Paradigm. 

Validate the Phases of Illness Paradigm and its effect on a variety of measures in three Burn ICUs 

c. Implement the POIP to improve the multidisciplinary burn ICU team’s understanding of patient illness 

severity, daily care priorities, and anticipated care goals. 


B. Keywords 


Team, Communication, Burn Intensive Care, Illness severity, Care Goals, Clinical Decision Support Tools, 
Phases of Illness, Cognitive Workload, Quality of Life, Card Sorting 


C. Overall Project Summary 


This project seeks to understand the work domain in the Burn ICU in terms of patient condition, patient 
progress, and dependent clinician behaviors in order to create ecologically valid checklists that support 
clinician work including decision making according to the Phases of Illness Paradigm. We will implement the 
POIP to improve the multidisciplinary burn ICU team’s understanding of patient illness severity, daily care 
priorities, and anticipated care goals. This project aims to validate the Phases of Illness Paradigm and its 
impact on a variety of measures in three Burn ICUs. In addition, we aim to further develop the Phases of 
Illness Paradigm by investigating the ecology of clinical behaviors in the team environment it is meant to 
support. Using surveys, we will evaluate the perception of the clinicians implementing the checklists on 
teamwork and communication effectiveness. 


The objectives of this program are as follows: 


a. Implement the POIP to improve the multidisciplinary burn ICU team’s understanding of patient illness 
severity, daily care priorities, and anticipated care goals. 

b. Understand the work domain in the Burn ICU in terms of patient condition, patient progress, and 
dependent clinician behaviors in order to create ecologically valid checklists that support clinician work 
including decision making according to the Phases of Illness Paradigm. 


c. Validate the Phases of Illness Paradigm and its effect on a variety of measures in three Burn ICUs. 


The project tasks are as follows: 


TASK ONE: Describe the patient progress through intensive care from patient-centric and provider- 
centric perspectives. This will include identification of general patient characteristics, provider 
perspectives, care priorities, therapeutics, activities, and care team goals at various times during a 
notional patient’s progress through intensive care. 


TASK TWO: Using the information discovered in task 1, create a representation that maps patient 
progress through the ICU in the form of checklists that identify patients’ and care team goals, 
objectives, and tasks that are commonly associated with a patient’s current condition (i.e. “phase of 
illness”). 


TASK THREE: Implement the phases of illness paradigm in three Burn Centers and assess its impact 
on provider understanding of patient status, care priorities, patient outcomes, and effect on 
communication, teamwork, quality of life, and cognitive workload. Comparative data for providers and 
patients will be obtained/initiated throughout the project beginning in month 3. 


TASK FOUR: Review and update the Phases of Illness Paradigm (POIP) checklists and assess the 
time it takes for new checklist items to be reliably completed without new/additional education for the 
healthcare team. 


1. Gantt Chart 
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2. Project Summary by Task 


TASK ONE. Describe the patient progress through intensive care from patient-centric and provider-centric 
perspectives. This will include identification of general patient characteristics, provider perspectives, care 
priorities, therapeutics, activities, and care team goals at various times during a notional patient’s progress 
through intensive care. 


Data collection for provider-centric perspectives was completed last year at all three sites. Data regarding the 
patient-centric progress through intensive care will be more thoroughly evaluated using retrospective data 
obtained during the study period at each participating institution. While there is no additional data at this time, 
further analyses of previously collected data remains ongoing and continues to reveal confirmation of findings 
previously reported as well as new insights. 


Indeed, mental models that clinicians use differ widely with respect to patient condition and care priorities. We 
investigated this using two different “surveys,” card sorting (i.e. the “clinician card sort test” or CCST) anda 
“clinician understanding survey” or CUS. In both tests, we asked clinicians to identify the illness severity ofaa 
patient they were caring for by placing a mark on a horizontal spectrum that represented the continuum from 
“most sick, could die today” to “least sick, could transfer today.” This scale is shown in figure 1. Figure 2 
shows representative examples of two patients for whom multiple clinicians were surveyed (in these examples, 
the survey was the card sort test). 


The least 
The sick ICU 
sickest patient: 
patient: Could 
Could Transfer 
Die to the 
Today ward 
today 


Figure 1. Scale used by clinicians to rate a patient’s current condition or “illness severity.” The blue line would 
have been made by aclinican before compling a card sort or a condition understanding survey. This scale may 
be divided into 10 equal parts and used to compare a clinician’s perception of patient condition to other clinicians 
caring for the same patient (see below). 
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Figure 2. Examples of differences clinician perception of patient condition or illness severity. Clinicians individually 
marked blank scales as in Figure 1. These two examples are synthesized from multiple individual scales to show the 
differences in clinical perspective about two different patients. In the top example, five clinicians rated the patient. The 
average score was 6.4 (range 4-8). In the bottom example, seven clinicians rated the patient. The average score was 
2.5 (range 1-5). Both examples represent significant differences in clinical perspective about patient condition that 
could impact clinical decision making about care goals, care priorities, clinician activity synchronization and planning, 
and, ultimately, patient outcomes. 


Interestingly, but not surprisingly, clinician perception about patient condition is more consistant 
(aligned) when patients are most sick and when they are least sick. Figure 3. Shows the variability (in terms of 
standard deviation) of individual illness severity ratings compared to the average illness severity rating for 
patients whom at least five clinicians rated. The main conclusion from this analysis is that the greatest 
potential for clinicians to disagree about a patient’s condition exists when patients are “middle sick.” 
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Figure 3. Standard deviation of illness severity ratings for comparisons of at least five individual clinician ratings. Variance of clinician 
perception is greatest in “middle sick” patients (average illness severity scores between 4 and 7). Ranges of individual ratings were has 
high as 4 points different as in the examples in figure 2. 


Perceptions about clinician information use and prioritize to make judgements about patient condition 
was also collected during the CCST. Although this data continues to be analyzed, the initial reviewed also 
demonstrated notable differences in how clinicians of different clinical backgrounds (i.e. nurses vs. physicians) 
and of difference experience levels (i.e. attending vs. resident) use information to make these judgements. A 
simple method for displaying these differences are word clouds. Although these are not a traditional format in 
medical literature, social sciences use them to demonstrate thematic differences between groups or to reveal 
patterns. In the word clouds shown in figures 4 and 5, words size represents the frequency (i.e. 
picks/subjects) that a card was selected to assess patient condition. Information frequency also changes by 
illness severity; in other words, some information is prioritized more frequently to assess patient condition if a 
patient is more vs. less sick (data not shown). 
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Figure 4. Comparison of word clouds generated from attending physician and nurse card sorts. Relative word size represents the 
frequency that information element was chosen to form an assessment of a patient’s illness severity. Larger words were chosen more 
frequently than smaller words. Attendings appear to focus more on problems, diagnoses, categorical ideas (i.e. organ failures, mental 
status, ventilator mode), plans and goals to assess patient condition whereas nurses appear to be less consistenent of focus, 
evidenced by smaller, more numerous words, and seem to focus on more data driven information elements (i.e. vital signes, urine 
output, blood pressur), acuity/workload (i.e. renal replacement therapy, mehancical ventilation and its plan), and gestault (i.e. “general 
condition”) to make these assessments. 
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Figure 5. Comparison of word clouds generated from attending physician and resident card sorts. Relative word size represents the 
frequency that information element was chosen to form an assessment of a patient’s illness severity. Larger words were chosen more 
frequently than smaller words. Interestingly, residnets (less experienced physicians) chose more information sources, and more cards 
overall, than did attending physicians as evidenced by the larger word cloud. Resident physicians seem to have difficulty focusing on 
any particular information source or concept when making assessments of patient illness severity. 


As part of the CCST, clinicians were also asked to describe their patient using key terms. Some key 
terms were identified during CCST tool development through in depth interviews with clinician experts. These 
were offered to subjects completing CCSTs for simplicity (i.e. they could circle terms they would use), but 
clinicians were also permitted to offer their own terms. In general, clinicians chose multiple terms to describe 
their patients (5+/-2 terms on average). Very few terms had any discriminatory power for identifying patients of 
any particular illness severity. An apparent pattern does exist (See Figure 6), but it is clear that clinicians in 
three burn ICUs lack a common language that could help clinical teams perceive patient condition more 
consistently. 
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Figure 6. Contour plot showing the frequency of terms chosen according to patient illness severity as indicated by clinicians. 
Percentage = the count of a term divided by the number of surveys/illness severity score. Also shown are the number of times a term 
was chosen overall (term count), the mean illness severity for which a term was choses (mean severity), and the difference between 
the frequency a term was chosen within the A Priori Group (least sick = 1-3, middle sick — 4-7, most sick = 8-10) and Final Group 
(where most sick = 7-10) vs. outside the group (strength within group). This statistic helps differentiate terms that are used often (i.e. 
by many clinicians) and are consistent with a particular illness severity group. Of note, illness severity in reality is not discrete: it 
represents a continuum of patient condition. Here, we try to demonstrate that with a gradient of color whereas in the analysis we uses 
three discrete groups. 
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Patterns of care priorities were discussed with and described by clinicians during the second group 
interviews that were designed to validate the POIP model. As shown below in figure 7, clinicians alter care 
priorities according to their perception of patient condition. Laboratory evaluation, monitoring, mechanical 
ventilation, venous access, and medication management (i.e. ensuring the patient is on the correct 
medications) are all more prioritized in sicker patients whereas optimizing nutrition, sleep, wound care, and 
rehabilitation are all more prioritized in less sick patients. After evaluating patient cases, clinicians identified 
patient condition and then rated care elements accordint to highest, middle, and least prioritie. Highest priority 
was given a numerical rating of 8, middle priority a rating of 5, and lowest priority a rating of 3. Prioties were 
then averaged for call clinicians evaluating a patient as the same level of illness (not necessarily grouped by 
case). Thus, the representation in figure 7 depicts the clinician perception of care priotity according to patient 
illness severity, not according to the patient case presented. Some care elements may have a bimodal 
importance (i.e. mechanical ventilation, venous access, and wound care). When discussed, this patter 
generally reflected the following positions: when patients are “sicker” mechanical ventilation is added or 
increased in support, when they improve mechanical ventilation is weaned or discontinued. Similarly, venous 
access is added and removed when patients worsen or improve respectively. Finally, wounds must be 
thoroughly evaluated when patients worsen and wound care optimized when patients are improved/improving 
to prevent complications — also, patients tend to be more perioperative in middle illess categories. Renal 
replacement therapy seems to be generally important whenever it is utilized for any degree of patient illness. 
Similarly, analgesia and sedation, while not the highest priority at any time, remains a consistnely priority 
during all phases. Summing all of the priorities, even with relative scores, produced a rank-ordered list of 
overall care priorities of clinicians in the BICU: 
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Figure 7. Red = Most sick, orange = “high middle sick,” yellow = “low middle sick,” and green = least sick. Dark blud = highest priority 
(score of 8), pale blue = middle priority (score of 5). light grey = least priority (Score of 3). Numerical values represent average score of 
all clinicians who participated in group interviewed. An 8 indicates that all clinicians felt a care item was highest priority for that level of 
illness, whereas a 3 indicates it is of least priority. SOI: Severity of Illness; LABS: lab draws; MON: Monitors; MV: Mechanical 
Ventilation; ACC: Venous Access; MEDS: Medications; CRRT: Continuous Renal Replacement Therapy; A&S: Analgesia and 
Sedation; NUT: Nutrition; SLEEP: Sleep; WC: Wound Care; REHAB: Rehabilitation. 


Summary of Findings 


1. Multiple measurements demonstrate that mental models of patient condition and treatment priorities are 
highly variable, and change according to: 
a. patient condition, 
b. institution, 
c. profession or clinician type, 
d. and years of experience. 

2. Consistent patterns of information use, descriptive terminology, and treatment preferences exist that 
could be used to help create explicit models of patient condition and therapeutic appropriateness. 

3. These patterns, however, are spread along a condition versus in discrete phases. Therefore, clinician 
perceptions are often overlapping and, at times, at odds with each if individual clinician perspective is at 
distant locations on this continuum compared to other clinicians. 

4. Tools can be made to support explicit models of these patters that should facilitate clinician 
communication, better decision making, and consistency of patient care. 

5. These findings were presented at regional and national conferences (appendix A) and manuscripts 
(appendix B) of these findings are currently in draft. 


TASK TWO. Using the information discovered in task 1, create a representation that maps patient progress 
through the ICU in the form of checklists that identify patients’ and care team goals, objectives, and tasks that 
are commonly associated with a patient’s current condition (i.e. “phase of illness”). 


Each site has created tools that are similar in function, but differ in design and content (appendix C). These 
tools are: 
de A patient illness severity assessment tool. 
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2. A checklist tool that matches treatment options to patient condition. 
3. A “TeamView’” tool that helps clinicians to visually identify patient condition and care goals. 


While each of these tools have similar function, they differ slightly at each of the participating locations. These 
pragmatic differences stem from the cultures, personalties, other systematic processes, and leadership at each 
organization. For example, the TeamView at the Dallas site incorporated a diagram of the wounds a patient 
has, but this does not appear on either the Houston or USAISR TeamViews because these locations have 
other mechanisms for sharing that information. Both illness severity assessment and checklist tools also vary 
somewhat in that each participating location. These differences help improve the ecological validity of the 
model these tools support. Whether or not these differences are clinically important remains to be determined. 
Ultimately, identifying these differences, categorizing them, and, if possible, identifying “best” options will be a 
significant contribution of this project to the science of checklist creation and process improvement. 


One major difference in the development and implementation of these tools is worth highlighting. Tool 
development at Dallas site has been challenging for a variety of reasons: change in research team, physical 
move of the hospital to a new location, etc. Their version of tools are notably different than those at Houston or 
the USAISR. While the illness severity assessment tool is similar, they have chosen to create discrete 
checklist for different phases of patient illness (more similar to the original concept of POIP described by 
Pamplin, et. Al) instead of showing these checklist items along a continuum as was done at the other sites. It 
will be interesting to compare their tool use and it impact on patient care to that from the other locations. 


Also different at the Dallas site was a major challenge from their hospital leadership regarding the acceptability 
of posting the TeamView outside of patient rooms. While this practice was not an issue at the USAISR or 
Houston locations. Indeed, The Joint Commission inspection highlighted these tools as a “best practice” for 
communication while visiting the USAISR location. Nevertheless, the Dallas site is not showing the TeamView 
in site for the entire team to see. Instead, these are contained in a binder at the patient bedside which must be 
opened and interacted with. Again, these differences will be noted and described to help identify best 
practices to facilitate tool use. 


Finally, it is worth noting that using these tools changes how clinicians interact and perceive patient care. 
Observations of this are below (task three) and will be further described as we continue to analyze data. One 
observation, however, is clear: clinicians find completing and maintains these tools to be time consuming and, 
at times, tedious. This is a similar finding in other checklist projects. To reduce this burden, we intend to 
create software that facilitates tool completion if the project is approved for a one year, no cost extension. This 
software will be digital representation of the paper tools currently used, but will help clinicians through prompts 
and interface to more rapidly assess necessary updates. Future work could integrate such a tool with 
electronic medical records to further reduce task burden for the clinician. 


Summary of Findings 
1. Each site created tools to support the POIP model. Tools have similar functions, however they vary 
somewhat in form and content. These differences account for the differences in clinical cultures and 
expectations at each organization and improve the ecological validity of the tools for the work they 
support. 
2. Consistant tool completion, even if valuable to the team, remains challenging at all locations because 
they are an additional burden to individually overburdened, time pressured, task saturated clincians. 


TASK THREE. Implement the phases of illness paradigm in three Burn Centers and assess its impact on 
provider understanding of patient status, care priorities, patient outcomes, and effect on communication, 
teamwork, quality of life, and cognitive workload. Comparative data for providers and patients will be 
obtained/initiated throughout the project beginning in month 3. 


Numerous delays in implementation at the Houston and Dallas site occurred. Both sites have changed 
research coordinators during the course of the study. The Dallans site moved into a new hospital in 2015. 
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Also, the Dallas site has had some difficulty implementing the tools because, despite clinican preferences and 
empiric data recorded as a part of this project, the Dallas hospital leadership was reluctant to post the 
TeamView tool outside of patient rooms due to concerns about violating the Health Insurance Portability and 
Acountablity Act (HIPAA). Leadership at the USAISR and Houston sites did not perceive this to be a problem 
because no the TeamVlew does not contain any personally identifiable information (PII). Furthermore, the 
Joint Comission surveyed the USAISR site in 2015 and identified the TeamView tool as a “best practice” for 
team communications. Despite these arguments, the Dallas site was unable to convince leadership to post the 
TeamView so that it’s information would be available at the patient bedside for all team members, including 
patient family and friends, to see. 


After education of the staff, tools were incorporated into clinical workflow at each of the three participating 
centers: 

e USAISR on May 2014 

e Houston on April 2015 

e Dallas on November 2015 


Clinician perceptions about patient condition were measured using the clinician card sort test and the condition 
understanding survey (CCST and CUS respectively, see task 1) at the beginning of the study (pre-baseline 
time point). These perceptions were subsequently measured before implementation of the process 
improvement (i.e. before tools were introduced in the the clinical environment) and then at six months and one 
year (at the core site only, data at spoke sites is still being collected). Data for the core site about clinician 
perception of patient illness severity from the CUS is shown in figure 8 below. Comparisions at one year and 
from spoke locations at mid point evaluation will be analyzed soon. The core site data demonstrate that 
discussions about patient condition that occurred through tool development improved clinian agreement about 
patient condition and that introduction of POIP tools further improved clinician agreement. This suggests that 
the POIP improves the clinical team’s shared mental model of a patient. 
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Figure 8. The variance in clinician perception at three time points in from the core study location. Each data point represents the 
standard deviation of reported severity of illness scores for patients whom at least five surveys were returned. The average varience in 
these standard deviations was: pre-baseline, +1.73 and +1.37; baseline, +1.38 and +1.33; six months, + 0.7 and +0.76. The decreased 
variance for both current and anticipated condition was statistically significant at each time point (ANOVA, P = 0.01) 
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To assess workload perception we used the National aeronautics and space administration task load 
index (NASA-TLX). We used the TeamSTEPPS perception questionnaire (TPQ) to assess teamwork 
perceptions among staff. And the POIP User Satisfaction Survey to assess clinician opinions about the 
POIP tools and model. 


NASA-TLX 

The pre-basline NASA-TLX is a tool developed to assess cognitive workload across six scales: mental, 
temporal, performance, effort, frustration and physical. Baseline (pre-implementation) NASA-TLX data from all 
three sites assessed workload perception differences among clinician types, years of experience, institution 
and time spent with a patient. We sought to characterize clinician subjective sense of workload when 
performing two tasks. 


1. Identify if the patient is better, same, or worse than yesterday (severity of illness (SOI)). 
2. Identify the most important objectives of care for the patient today (priorities of care (POC)). 


After multidisciplinary rounds (MDR) on one patient the entire clinical team present was asked to assess their 
workload perception associated with those two tasks. For statistical analysis, we grouped clinicians into the 
following groups: 


e Student: medical students 

e Nurse: all types including registered nurse (RN), licensed practical/vocational nurse (LPN/LVN), clinical 
nurse specialist (CNS), etc. 

e Physician: all attending physicians (burn surgeons, intensivists), fellows and residents. 

e Other: all other credentialed providers not represented in any other category. 


Summary of Findings 

This data and analysis was accepted in manuscript form and is currently in press for the Journal of Burn Care 
and Research. The Manuscript describes the cognitive work performed by clinicians during MDR in the Burn 
ICU. The NASA-TLX effectively revealed workload perception differences and similarities in cognitive work 
associated with completing two critical tasks performed during MDR: identifying a patient’s condition (severity 
of illness, SOI) and prioritizing associated treatments (priority of care, POC). Significant findings include (see 
PDF of the submitted manuscript for full details in appendix B): 

1. Mental demand, temporal demand, performance, and effort were the primary determinants for the 
cognitive work performed for the identified tasks on MDR with mental demand being greatest; 

2. students, nurses, andphysicians all had higher perceived total workload for both SOI and POC than 
“others”; 

3. students perceived the most effort on rounds and had the most mental demand when identifying POC 
and significantly more than “others” when identifying SOI; 

4. students, nurses, and physicians experienced significantly more temporal demand when identifying 
POC than did “other” healthcare providers while only nurses and physicians perceived this significantly 
more than others for identifying SOI; 

5. clinicians with the least experience had higher perceived workload when identifying SOI and POC as 
compared to those with more experience; 

6. and some individuals perceived more frustration and physical demand than most others during MDR. 


We will analyzine the change in clinician cognitive work for these two tasks over time using this same tool at 
six months and study endpoint at each participating location. 
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TeamSTEPPS 


The TeamSTEPPS-Teamworwk Perceptions Questionnaire (T-TPQ) was completed at all three sites to 
establish baseline teamwork perceptions among clinicians. This tool was specifically designed for health care 
and has been validated across many different types of clinical settings. 


Summary of Findings 

The pre-baseline T-TPQ data has been collected at all three sites. We collected 129 surveys (physician: 19, 
nurse: 87, other: 23). There were no significant differences among clinician groups (nurse, physician, other). 
There was a high degree of acceptable perception of teamwork with a majority of staff (89-100%) across all 
sites having mean scores greater than 3 for all subscales. We also established good to excellent internal 
consistency and reliability for all scales (Cronbach’s alpha: .85-92). 


These results suggest that teamwork in the BICU is perceived as being better than many other ICU 
environments and that determining the underlying reason for better perceptions of teamwork in the BICU could 
be used to improve teamwork in other ICU settings. 


This data was presented in abstract form (see appendix A) and a manuscript is in draft. We will analyzine the 
change in clinician perception of teamwork over time using this same tool at six months and study endpoint at 
each participating location. 


USER SATISFACTION 


The User Satisfaction Survey is a ten-question survey. Each question assesses clinician perspectives about 
the POIP as a whole (the tools and overall model taken together) using a five point Likert scale (1 — strongly 
disagree, 2 — disagree, 3 — neutral, 4 — agree, 5 — strongly agree). For purposes of analysis, we grouped 
reponses into disagree (1 or 2), agree (4 or 5), and neutral (3). 


Six-month data was preliminarily analyzed for the core site only and will be presented at the American Burn 
Association Annual Conference this May. We surveyed 48 end-users: 3 Physicians, 30 Nurses, and 15 other 
healthcare providers (respiratory therapists, rehabilitation specialist, dietitians, pharmacist, etc.). Mean scores 
are shown below in figure 9. Overall satisfaction was rated above neutral (3.23 + 0.98). Physicians were more 
satisfied than nurses: 100% Satisfaction (n =3) vs. 36% dissatisfaction (n=30). 
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Overall satisfaction 
Improves patient outcome 
Improves patient care 
Adequate Training 
It is helpful for training 
Improves my understanding. . 
| trust the outputs 
Comfortable with using 


Easy to use 


It Interferes with my work 


1.0 2.0 3.0 4.0 5.0 
Strongly Disagree Strongly Agree 


Figure 9. Mean scores for clinician perception of the Phases of Illness Paradigm 
and the tools used to introduce this model of patient care to one Burn ICU. 


Summary of Findings 


A 


2. 


The POIP checklist tools supported teamwork and communication without interfering with workflow for 
most participants 

After 6 months of use, most clinicians were comfortable with the tools yet daily use was lower than 
expected 

We used this and other data to update tools (see below) to improve use and, hopefully, user 
satisfaction. 

We will analyze the change in clinician perception of the POIP and its tools over time using this same 
survey at the other participating sites and at all sited at study endpoint. 


We are currently developing a retrospective protocol that will assess the impact of these interventions on 
clinician performance (i.e. adherence to the suggested practice patterns outlined by the POIP tools) and on 
patient outcomes. This retrospective protocol will be submitted for IRB and HRPO review in the next quarter. 


TASK FOUR. Review and update the Phases of Illness Paradigm (POIP) checklists and assess the time it 
takes for new checklist items to be reliably completed without new/additional education for the healthcare 


team. 


The core site updated their tools from March to July 2015. The new tools and workflow were introduced in July 
2015 (appendix C). Key finding and changes included: 


ae 


The tools when used, were valuable for team situational awareness, but when not completed 
consistently led to dissatisfaction with their outputs and little impact on patient care. Users requested to 
incorporate the tools key features (illness severity assessment and corresponding checklists of care 
priorities) into their daily workflow. This was accomplished by developing both nurse and physician 
report tools. Nurses could use these tools during change of shift report and residents could use these 
tools when reporting for multidisciplinary rounds. 


The TeamView was perceived to have the most potential benefit for team communication, but it was 
underutilized. The most important feedback was that the tool was not referenced or reviewed during 
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multidisciplinary rounds. When it was, the tool was perceived as providing value. This lead toa 
decision that resident physicians and physician assistants would be responsible for updating the 
TeamView (vice nurses) and emphasis on using the tool during rounds. 


3. Team View was modified so that it did not duplicate information found in other areas of the team’s 
workflow. Specifically, the daily checklist items were removed from the TeamView, as these were 
already available in multiple other locations (the EMR note, the “charge nurse checklist” and the 
resident handoff tool). Additional areas were added to leave messages, identify patient allergies and 
code status, and to prioritize/synchronize commonly conflicting care tasks (i.e. procedures vs. wound 
care vs. rehabilitation vs. imaging). 


4. Aseparate TeamView tool was created for patients on extracorporeal membrane oxygenation (ECMO) 


Assessment of the impact of these changes is currently ongoing at the core site for final data collection. 
Anecdotal observations following the tool updates are: 1. The TeamView tool is updated consistently and is 
valued by team members for maintain the “whole picture” of a patient. Family members interact with the tool to 
get a daily update on patient condition. 2. Scales and checklist tool use remain inconsistent. Nursing staff do 
not use them. Physician staff, primarily residents and medical students, find the tools valuable to get a “gist” of 
patient progress through the BICU, important care elements, and how to apply these care elements. 


The Houston site implemented their tools in March 2015, but due to low patient volume and a change in their 
site’s research nurse, their mid-point assessment and tool update is currently on going (April 2016). The Dallas 
site implemented their tools in November 2015. They changed research nurses associated with this project 
between March and April 2016 and will start mid-point assessment and tool updates as soon as possible. 


Assessment of tool impact on patient outcome and clinician reliability will be evaluated through retrospective 
review of electronic medical record data. This protocol is currently being written. 


D. Key Research Accomplishments 


e Models of clinician perceptions of patient condition and progress through the Burn ICU are described at 
all three sites. 

e Tools that aid clinical assessment of patient illness severity and that help identify important treatment 
priorities are implemented at 3 sites. 

e Differences in hospital and unit level leadership, and unit culture directly impact the success of process 
improvement. Differences in these important system features at each location have led to variability in 
how tools are implemented, valued, and utilized. 

e There are differences in how clinicians think demonstrated by the mental models elicited from the card 
sort data, the condition understanding data, and through individual and group interviews. There are 
differences among professions or clinician types, by years of experience, and among institutions. 
These differences are important to acknowledge as they impact communication, care coordination, and 
ultimately patient safety and outcomes. 

e The process of studying clinician perceptions about patient condition and implementing a model of care 
that highlights patient condition and care priorities makes clinician perception about patient condition 
more consistent. 

e There are differences among professions or clinician types in workload perception, with statistical 
significance between: 


o Students and others for mental and overall effort. 
o Physicians and others for overall workload. 

o Nurses and others for overall workload. 

o Physicians and others for temporal demand. 

o Nurses and others for temporal demand. 
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e Mental, temporal, performance and effort all contribute significantly more to the overall cognitive 
workload than physical or frustration subscales. 

e Teamwork perception at all three sites was perceived as highly favorable. 
The T-TPQ is a valid and reliable tool to measure teamwork perception in the burn ICU. 


E. Conclusions 


The Phases of Illness Paradigm in a valid model for patient progress and care prioritization in the Burn ICU. 
Differences in clinical perception of patient condition and care priorities impacts patient treatment. When 
Clinicians have different mental models of a patient, care may be fractured, priorities may be different, and 
friction occurs between clinicians. When clinicians share the same mental model of a patient, care is consistent, 
synchronized, and clinicians will likely perform better as a team. 


Process, workflow, and leadership all play an important role in implementing systematic changes in how 
clinicians perform work. Even when processes may improve patient care, if they do not match clinician workflow 
or leadership does not prioritize them, there is marginal adoption of the process, little change in culture, and 
limited impact on patient care. When process matches workflow and leadership supports change, then tools 
like the POIP model can impact and change unit culture. 


Final data collection and analysis is ongoing for this project at the core site. 


F. Publications, Abstracts, And Presentations 
Manuscripts 


1. Mclnnis |, Murray S, Serio-Melvin M, Aden J, Mann-Salinas E, Chung K, Huzar T, Wolf S, Nemeth C, 
Pamplin J. “Comparing the workload perceptions of identifying patient condition and priorities of care 
among burn providers in three Burn ICUs.” Journal of Burn Care & Research [In Press] 


Presented Abstracts 


1. Pamplin J, Murray S, Serio-Melvin M, Aden J, Huzar T, Wolf S, Chung K, Nemeth C. “Variations ona 
theme: How clinician descriptions of patient condition diverge.” Presented at the Society of Critical Care 
Medicine Annual Congress, 21-24 February 2016, Orlando, FL. 

2. Murray S, Pamplin J, Serio-Melvin M, Aden J, Mann-Salinas E, Chung K, Huzar T, Wolf S. “Using 
Focus Group Interviews to Validate Team Communication Tools in the Intensive Care Unit.” Presented 
at the Society of Critical Care Medicine Annual Congress, 21-24 February 2016, Orlando, FL. 

3. Murray S, Serio-Melvin M, Aden J, Mann-Salinas E, Chung K, Huzar T, Wolf S, Nemeth C, Pamplin J. 
“Developing Cognitive Tools for the Intensive Care Unit: A Mixed Methods Approach.” Presented at the 
Tri-Service Nursing Research Program Annual Conference, 2015, Bethesda, MD. 

4. Murray S, Serio-Melvin M, Aden J, Mann-Salinas E, Chung K, Huzar T, Wolf S, Nemeth C, Pamplin J. 
“Revealing the different perceptions burn ICU clinicians have regarding patient illness severity and 
clinical treatments using card sort methodology.” Presented at the Tri-Service Nursing Research 
Program Annual Conference, 2015, Bethesda, MD. 

5. Murray S, Chung K, Mann-Salinas E, Serio-Melvin M, Huzar T, Wolf S, Nemeth C, Pamplin J. 
“Developing Cognitive Aids According to the Phases of Illness Paradigm for use in the Burn ICU.” 
Presented at the Military Health Research Symposium, 17-2701 August 2015, Ft. Lauderdale, FL. 

6. Brown T, Murray S, Serio-Melvin M, Aden J, Mann-Salinas E, Chung K, Huzar T, Wolf S, Nemeth C, 
Pamplin J. “Perceptions of Teamwork in the Burn ICU.” Presented at the Military Health Research 
Symposium, 17-2701 August 2015, Ft. Lauderdale, FL. 

7. Mclinnis |, Murray S, Serio-Melvin M, Aden J, Mann-Salinas E, Chung K, Huzar T, Wolf S, Nemeth C, 
Pamplin J. “Comparing the Workload Perceptions of Determining Patient Condition and Priorities of 
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Care Among Burn Providers in Three Burn ICUs.” Presented at the Military Health Research 
Symposium, 17-2701 August 2015, Ft. Lauderdale, FL. 

8. Murray S, Serio-Melvin M, Aden J, Mann-Salinas E, Chung K, Huzar T, Wolf S, Nemeth C, Pamplin J. 
“Comparing the workload perceptions of determining patient condition and priorities of care between 
burn providers in three burn ICUs.” Presented at the American Burn Association Annual Meeting, 
Chicago, IL April 2015 

9. Pamplin J, Serio-Melvin M, Aden J, Mann-Salinas E, Chung K, Huzar T, Wolf S, Nemeth C. 
“Discovering mental models that burn ICU clinicians' use for decision making using card sorts.” 
Presented at the American Burn Association Annual Meeting, Chicago, IL April 2015 


Accepted Abstracts for Presentation 


4. Leazer S, Murray S, Serio-Melvin M, Aden J, Mann-Salinas E, Chung K, Huzar T, Wolf S, Nemeth C, 
Pamplin J. “Understanding Clinician Perspectives of Patient Condition and Care Goals in the Burn 
Intensive Care Unit.” Accepted for presentation at the American Burn Association, Las Vegas, NE, 4-7 
May 2016 

5. Pamplin J, Murray S, Serio-Melvin M, Aden J, Huzar T, Wolf S, Chung K, Mann-Salinas E. “Getting the 
Burn Team to play from the same playbook: Understanding clinician perception of patient condition.” 
Accepted for presentation at the American Burn Association, Las Vegas, NE, 4-7 May 2016 

6. Murray S, Phillips S, Rodriguez J, Serio-Melvin M, Aden J, Mann-Salinas E, Chung K, Nemeth C, 
Pamplin J. “Achieving Ecological Validity: Creating Decision Support Tools for the Burn Intensive Care 
Unit.” Accepted for presentation at the American Burn Association, Las Vegas, NE, 4-7 May 2016 


G. Inventions, Patents And Licenses 
Not applicable. 


H. Reportable Outcomes 


1. The core site has described how clinicians perceive patient condition and progress through the ICU. 
These perspectives have been organized into a “scales tool” and a “bedside checklist tool.” The 
final implemented tools and the Core Site in-service are included in appendices B & D and 
appendix J, respectively. These tools and their development were presented in abstract form at the 
Military Health System Research Symposium, Ft. Lauderdale, FL, 18-21 August 2014 (previously 
submitted) and were presented nationally at the Society of Critical Care Medicine Annual Congress, 
17-21 January 2014, Phoenix, AZ. 

2. Using data collected from the Core and Houston Sites, the project has identified significant 
differences in the mental models that clinicians use to prioritize information related to patient 
condition and treatments. Physicians, nurses, physician trainees, respiratory therapists, 
nutritionists, and clinicians of different experience levels prioritize information and treatment options 
differently. These results have been presented at the American Burn Association Annual 
Conference, 21-24 April 2015, Chicago, IL (previously submitted). 

3 We have also analyzed the NASA-TLX data from all three participating sites and have described 
the cognitive workload that clinicians perceive while performing the tasks of identifying patient 
condition and treatment priorities during multidisciplinary rounds. Clinicians of different experience 
levels and of different professional backgrounds perceive their workload differently. Decreasing this 
workload may free cognitive processes to focus on more important decisions. These results were 
presented to the American Burn Association Annual Conference, 21-24 April 2015, Chicago, IL 
(previously submitted). In addition, a manuscript on this topic is in press for publication in the 
Journal of Burn Care and Research (previously submitted). 
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10. 


11. 


These mental models have been used at the Core and Houston sites have validated the “scales” 
and “checklist” (now called “TeamView’) tools through focus group interviews. The tools have been 
produced for use at the core site and have undergone unit level review at all three sites, and pilot 
testing at 2 sites (previously submitted). 

We have analyzed the first round of TeamStepps data from all three sites and found that there were 
no significant differences among the clinician groups, sites, or for experience levels. There was a 
high degree of acceptable perception of teamwork. The majority of staff (89-100%) across all sites 
had mean scores greater than 3 for all subscales. We found that the TeamStepps perception 
questionnaire had good to excellent internal consistency and reliability for all scales (Cronbach’s 
alpha= .85-, .92). A manuscript explaining this data is in progress. 

We have analyzed the CUS data, pre-baseline round 1 from the core site, quantifying the text data 
(thematic analysis). The CUS tool asked all clinicians caring for the same patient to identify how 
sick their patient was (0-10 scale) and note the goals, objectives, and tasks for the current day and 
the next day. We identified 169 responses from 60 participants that met the definition of “goal.” We 
were able to identify that clinical teams have difficulty perceiving common goals for patients, often 
misidentifying objectives as goals. There was very little goal agreement between clinicians caring 
for the same patient. (previously submitted). 

We also analyzed the variance in severity of illness scores (SOls) on the first 3 rounds (pre- 
baseline, baseline, and at 6 months of tool use) at the Core site. We found a significant decrease in 
variance over the study period (ANOVA, p=0.01). (previously submitted). 

We analyzed the user satisfaction surveys at the core site and found that users (n=46; Physicians: 
3; Nurses: 30; Other: 13) were in agreement that the tools supported teamwork and communication 
without interfering with workflow. After 6 months of use, most clinicians were comfortable with the 
tools. The POIP checklist tools are ecologically valid and support the work domain of the burn ICU 
Clinicians. 

We analyzed the focus group interviews at the core site (n=28 participants, 6 groups) finding that 
clinicians identified SOI according to their perception of patient overall condition and current 
trajectory. Temporal and historical factors play important parts in not only determining how 
clinicians think about their patients but also how they prioritize care. Understanding team perception 
may improve communication and patient safety. 

We analyzed the card sort surveys and found that the language that ICU clinicians use to describe 
patients poorly differentiates them according to SOI. Of the 169 clinicians and 77 unique patients 
(Staff Physician: 25; Nurse: 61; Resident: 40; Others: 43), on average staff physicians chose 5+2 
descriptors, nurses and residents chose 4+2 descriptors, and clinicians in other roles chose 6+2 
descriptors. Eight percent added novel terms, and only one term was consistent with a specific 
category (“ready for transfer” with least sick). 

Using thematic coding we analyzed the baseline Condition Understanding Surveys (CUS) 
responses identified as “goals” (n= 60 clinicians, 169 responses) finding 95 (57%) met the definition 
of a goal. Among the coded goals, the top 3 were: Adequate perfusion/Monitor Perfusion (19%), 
Ventilator Liberation (12%) and Infection Treated/Cured (12%). Top goals varied according to 
patient condition: for Least Sick patients, the top coded goal was to "Transfer to Ward" (29%); for 
Middle Sick patients, they were "Ventilator Liberation" and to "Improve Function/Rehabilitation 
Tolerance" (10% each); and for Most Sick patients, it was "Adequate Perfusion/Monitor Perfusion" 
(28%). Overall goal agreement between team members was 28% +/- 17%. Overall, we found that 
clinicians had difficulty identifying common goals for patient care and often misidentify objectives 
and tasks as goals. There was very little agreement in goals between team members. 


Other Achievements 


Nothing to report. 
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J. Future plans and funding options. 


Because of delays in implementation and data collection at all research sites, but primarily at the Houston and 
Dallas sites, the PI has requested a one year no cost extension (NCE) to complete work. The Houston Site is 
in the process of updating tools and workflow. The Dallas site will do so shortly with a new research 
coordinator. We will complete final data collection and analysis after sites complete at least three months of 
tool use. 


A retrospective protocol that assess the POIP’s impact on patient outcome and clinician reliability is being 
written. This protocol will review electronic medical record data and compare patient condition identified 
electronically to POIP conditional assessments, evaluate variance in patient therapies that are recommended 
by the POIP checklists, consistency of POIP tool completion, and overall patient outcomes. 


The core site has nearly completed final data collection. As this occurs, this site will start to implement new 
clinical practice guidelines that incorporate patient illness severity assessment and targets management 
strategies accordingly for mechanical ventilation and for pain, agitation, delirium, and sedation. 


Because of savings in research coordinator costs at the core site, we are able to fund a software engineer to 
create a digital version of the POIP tools (illness severity assessment tool, corresponding checklists, and the 
TeamView) if the NCE is approved. We anticipate that this type of technology can help facilitate POIP 
implementation and enhance workflow, primarily by reducing clinician time. 
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Introduction 


Nurse 
Others Doctor 
Multidisciplinary 
Team: 
Rehab Dietician 


a 
LTC Jeremy C. Pamplin, MD jeremy.c.pamplin.mil@mail.mil 


Consider this... ABG@ 


¢ Have you ever experienced the following: 


— Although a plan of care was established, the entire team was 
not on the same sheet of music? 

— You had a “gut” feeling that your patient was “sicker” (or “less 
sick”) compared to how the rest of the team was treating 
him/her but you couldn't quite explain it? 

¢ And you certainly could not explain your “feeling” to other team 
members? 

— That there was a disconnect between how aggressive (or too 
cautious) the team was being with respect to a plan of care 
compared to your own “instinct” of what should be done? 
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LTC Jeremy C. Pamplin, MD jeremy.c.pamplin.mil@mail.mil 


Hypothesis BG 


° Hypothesis: 
— Anovel research method may uncover different mental 
models that team members have regarding patient illness 
severity and clinical treatments. 
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Q Methodology: Card Sorting BG 


¢ Q Methodology: Developed by psychologist: Dr. William Stephenson (1935) 
¢ Framework to study subjectivity 
¢ Quantitative method to evaluate subjective data 


¢ Used in 
¢ Information Architecture and web design: 
used to understand an end-user’s point of view 
¢ Nursing, Veterinary, Medicine, Public Health, Transportation, Education, etc. 


Using QMethodology to Identify Reasons for Distress 
in Burn Survivors Postdischarge 


Shelley Wiechman Askay, PhD,* Michael Stricklin, PhD,f 
Gretchen J. Carrougher, RN, MSN,f} David R. Patterson, PhD,* 
Matthew B. Klein, MD, FACS,t Peter C. Esselman, MD,* 
Loren H. Engrav, MD, FACS} 
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Card Sorting B® 


° We developed a card sort based on interviews with burn 
critical care experts (a burn surgeon, intensivist, and nursing 
staff). 

e The final card set included 97 cards: 

— 6/ cards in 10 categories of “features” used to judge patient 
illness severity 


— 30 cards in 9 categories “treatments,” for a total of : 67 
features and 30 treatmenis. 
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pA 


° Card Sort Technique: 
¢ Participants are asked to think about their patient and 
determine on a scale of 1-10, how sick their patient is 
— 1 =Least Sick, “could transfer today” 
— 10 = Most Sick, “could die today” 
° Step 1: 
— Select all the cards that represent features that you consider 
important to how sick your patient is 
— Cards are then organized in grid 
° Step 2: 
— Select all the cards that represent the treatments you think 
this patient should have 
— Cards are then organized in grid 
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Methods BG 


e Part of a prospective, mixed methods study of clinical 
decision making and how to create tools that support it 


e 3 academic, regional referral burn ICUs. 
¢ Approved by the institutional review board at each site. 
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Card Sorting 


pt] 


Example Feature Card Sorts 


Sickest Patient/Could Die today (SOI 10) Least Sick Patient/Could Transfer (SOI 1) 


Rehabilitatic 
Goal/Plan 


Wounbps 


We 
Open 
% Open Wounds 
is Yy 
Wound Care 
Complexity 
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ys 
Example Treatment Card Sorts Ag 


Sickest Patient/Could Die today (SOI 10) Least Sick Patient/Could Transfer (SOI 1) 


iat 


NUTRITION 
Support 


Fluid/Volume Goal 


Renal Replacement 
Therapy 


Sedation 


Medication 
Strategy 


NUTRITION \ AAG 
a ~ ‘ 
Crees . \ Monitors} 


MOnirorinc } 
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Results 


° 169 card sorts, 77 patients 
° Average time: 35.5 + 15.8 min [10-100 min] 
° Average # Feature Cards: 9 + 2 cards [8-16] 


° Average # Treatment Cards: 8 + 2 cards [3-14] 
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Clinician Perception BG 


e In the diagram below, please use a vertical line to indicate “where” 
your patient is today: 


| The least 
The sick ICU 
sickest patient: 
patient: | . / Could 
Could - Transfer 
Die to the 
ward 
Today today 


| The least 
The } sick ICU 
sickest patient: 
patient: | Hj | Could 
Could ‘ ‘ Transfer 
Die i I to the 
ward 
Today 1 ioday 


27 yrs RN I, 13 yr 10 yrs 
39 yrs BF, 6 yr 
RT, 2 yr 
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ys 
Perception of Illness Severity Ze 


Average Percieved Illness Severity of Patients on whom at 
least 5 sorts were performed 


Average Illness Severity 


55 55 5.5 6.6 
Average Illness Severity 


Standard Deviation of Clinician Perception of Illness Severity 
by average Perception of Illness Severiy 


2.5 


f% 


app CON Zo 
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Average Illness Severity 
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Positioning 


Limitations ys o 
“All models are wrong, but some are useful.” — G. Box y % 


e Subjects review cards created by the research staff during 
interviews with a small number of clinicians. 
— The mental models may be anchored by the card set 
available 
— Example: a clinician considered pulse pressure variability as 
an indicator of volume status but since that card was not 
specifically available, the subject choses 
¢ to pick a card that represented the same concept (e.g. 
Monitoring: CVP) 
¢ to opt for a different card/concept altogether or 


° Did not investigate the intra-rater reliability 
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nm ys 
Es Conclusions Be 


¢ Burn ICU clinicians have different perceptions about 
— patient condition 
— treatment priorities 
e The card sort method successfully elicits mental models 
from clinicians during routine daily activity 


— These models vary according to patient illness severity, clinician 
type, clinician experience, and institution 
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nm ys 
Es Conclusions Be 


¢ These differences likely impact effective communication: 


What happens when the nurse communicates a different 
message than the attending to the family? 


° Better understanding and awareness of these differences in 
mental models may improve teamwork. 


e Will aid the development of decision support tools. 
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Thanks to all of the clinicians who 
took part in the card sorts. 
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Introduction Results Discussion 


¢ Burn critical care is complex and error prone due to high ¢ The data represent 116 clinicians, 5 patient MDRs, across 3 sites including 14 staff physicians, 25 nurses, 18 residents, 37 in other Key Findings: 
cognitive workload associated with information overload roles, and 13 students. ¢ Mental demand, temporal demand, performance, and effort 
and miscommunication. ¢ The sample reported moderate difficulty (weighted cognitive load= 42) for both tasks. were the primary determinants in equal proportions for the 
¢ Mental, temporal, performance, and effort all contributed significantly more to the overall cognitive load than physical or frustration cognitive work performed for the identified tasks on MDR. 
¢ Multidisciplinary Rounds (MDR) in the Burn Intensive Care subscales. a ; | | | | | 
Unit (BICU) are the mechanism for reviewing patient status Task 1: Identify if the patient is better, same or worse than yesterday Providers with less experience have higher perceived 


workload when identifying SOI and POC as compared to 


and planning care in the burn intensive care unit (BICU). those with more experience. 


Table 1: Cognitive Workload by Profession 
¢ Students exert more mental work and overall effort to 
identify SOI and POC than all others. 


¢ The cognitive work associated with MDR is often 


unrecognized. * Significant Comparisons: 
All | 
¢ The National Aeronautics and Space Administration Task See ee 


Load Index (NASA-TLX) assesses workload on 6 scales: 
Mental, Temporal, Performance, Effort, Frustration, & 
Physical. 


NM PDP 
Oo Oo 
oOo oO 


¢ Non-physician, non-nurse providers as a group perceive 
- less workload identifying SOI and POC than do physicians 
— and nurses. 


—_—s 
O 
Oo 


Scale score X frequency 
on on 
© © 


¢ Physicians and nurses experience significantly more 


Mental Temporal Performance Effort Frustration Physical Total Load temporal demand completing these tasks than do non- 
@ Students =@ Nurses m@ Physicians C1 Others ohysician/n urses 


© 


Objectives Table 2: Cognitive Workload by Years of 


Experience Conclusions 


¢ We sought to characterize clinician subjective sense of 
cognitive workload while completing 2 tasks: 


significant Comparisons: 
¢ A,B, G, H =p < 0.0001 


¢ The work of identifying patient condition and treatment 


Scale score X frequency 


riorities varies according to clinician tyoe and experience 
Task 1. Identity[ing] if the patient Is better, same or worse te ee 50 thai evel but not by institution or the time ied ann for a 
than yesterday (Severity of Illness); and ge ed : patient. 
Mental Temporal Performance Effort Frustration Physical Total Load 
Task 2: Identity[ing] the most important objectives of care Task 2: Identify the most important objectives of care far,the patient taday * Identifying patient condition and treatment priorities may 
for the patient today. aifect workflow, decision-making, communication, and 
teamwork. 


Methods 


¢ Understanding how various clinical roles perceive cognitive 
workload differently could lead to work process 
improvements and IT support for better clinician and team 


(ce) 
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© Af | h staff ional 
ter consents were obtained, research staff at 3 regiona fable 3: Counitive Workload by Prolession 


referral centers administered the NASA-TLX to the 250 mane 
multidisciplinary team: S 500 Pen Mianee: 
Significant Comparisons: £ | | | | 
150 ° : 
- Immediately after MDR on a single patient © A=p< 0.05 ey re ame Is useful In assessing workload perception 
- B, C=p<0.005 g 100 x : 
¢ Using paper or electronic formats (tablet) ¢ D p=0.0006 & 50 k 
- E,F, G=p<0.0001 "0 ) , Acknowledgements 
¢ At different points in time: early, middle or late in the MDR Mental Temporal Performance Effort Frustration Physical Total Load 
activit = Students = Nurses @ Physicians © Others 
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¢ Physician: all attending physicians (burn surgeons, 
intensivists), fellows and residents 
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Scale score X frequency 


Mental Temporal Performance Effort Frustration Physical Total Load 
m< 5Y m5-10Y O>10Y 
¢ Other: All credentialed clinicians not represented in any 


other category 


¢ Statistics: One-way ANOVA 


The opinions or assertions contained herein are the private views of the authors and are not to be construed as official or as reflecting the views of the Department of the Army or the Department of Defense. This study was conducted under a protocol reviewed and approved by the US Army Medical 
Research and Materiel Command Institutional Review board and in accordance with approved protocol. 
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Introduction Objectives Discussion 
¢ Teams of individuals from different professional backgrounds, provide complex care Primary * BICU clinicians think about patients in different ways. 
for patients in Burn Intensive Care Units (BICUs) -To understand the BICU work domain in terms of patient condition, patient progress, - Shared mental models may improve team understanding of patient condition and care 


and clinician behaviors in order to create ecologically valid cognitive aids. priorities. 
e Although patient condition is a continuum, clinicians perceive certain types of care 

more discretely along that continuum and may anticipate priorities of care accordingly. 
e Tools may improve recognition of discordant care and may expose differences of 


perspectives which may foster improved communication. 


- Team care is challenged by communication lapses borne from differences. 


- Professional silos may produce discordant care. ‘To improve the multidisciplinary Burn ICU team’s understanding of patient condition, 


¢ Well designed, ecologically valid cognitive aids help clinicians make decisions more dally care priorities, and anticipated care goals. 


efficiently, reliably, and accurately and may improve patient care. | 
eTo validate the POIP as a shared mental model. 


- Checklists, clinical pathways, order-sets, protocols, and guidelines are 


examples of cognitive aids that improve outcomes in healthcare. Secondary Key Points 
eTo further develop the POIP by investigating clinical behaviors in the environment it is 
ie lionel _ haliainin Paste Lally ae hariedhaan Mame! Oia ens ie meant to support. e The described research will develop ecologically valid cognitive aids to support 
describe patients with similar severities of illness for which clinicians may define slinieal decision malinanine BICL 
expected goals, objectives, and tasks of care. Evnlarai , : | | 
Xproratory ¢ We anticipate that the POIP will: 
¢ This research was designed to eTo determine if a shared mental model will improve clinician perception of * decrease cognitive load 


communication, teamwork, work satisfaction, and cognitive workload in the burn ICU. , . 
¢ improve communication 


- Validate the POIP framework as shared mental model 
e make care more reliable 


- Develop ecologically valid cognitive aids to support the POIP 


Methodology 


This Institutional Review Board approved protocol includes mixed methods, participatory research project broken down into four main tasks: 


Task 4: Review and Update 


Task 3: Implement the POIP in the BICU 


Task 2: Develop Representations of 
Patient Progress 


Task 1: Describe a Patient’s progress 
through the BICU 


¢ Once implemented, a continuous 
improvement process will occur with 
updates as needed. 


e Prospective and retrospective data Is 
collected to compare clinician 
perspectives and patient outcomes 
before and after POIP implementation. 


Delphi Consensus Building ° 


The elements from the card sorts and group ° 
interviews were correlated with severity of illness 
scores on the scales. 

- 80% consensus was achieved on each of the 

elements for the final version. 


Group Interview 


Clinicians perceive patient condition along a continuum 

Two tools emerged from the data: 

- A “scales tool” that is granular and identifies clinician perception of patient status along 
the continuum of care. 

- A “checklist” tool for discrete data elements of care and to provide a summative report. 


Condition Understanding Survey ° 
NASA-TLX Survey - 
TeamSTEPPS Survey 

Clinician Card Sort: Q Methodology 
Group Interview 
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Introduction Results Conclusions 


- The burn intensive care unit (BICU) is a data dense A total of 116 completed surveys were collected from a group that included 41 physicians, 25 nurses, 13 students ¢ There are differences in workload perception by 


environment where clinicians from many disciplines and 37 other providers members of the same multidisciplinary team 
work together to provide care ¢ Median total load for SOI was 40 (lIQR:13-67), while median total load for POC was 43 (lIQR:18-68) ¢ Key Findings: 

* Multidisciplinary rounds (MDR) is a collaborative ¢ Mental demand, temporal demand, performance, and effort were principle contributors to the overall cognitive 1. Mental demand, temporal demand, performance, 
activity designed to discuss patient data and load and effort were the primary determinants for the 
formulate care plans ¢ Weighted subscale values range from 0-500 (subscale value 0-100 x subscale weight). The total load scales cognitive work performed for the SOI and POC 

| | | | range from 0-100 and are equal to a sum of the weighted subscale values divided by 15 on MDR 
me SSSA Senet Saee SOAENIer eSe 300 - =a 2. students, nurses and physicians all had higher 
Ul cai! 7 ala . perceived total workload for both SOI and POC 


¢ Cognitive work associated with participation in MDR 
in the BICU has not been described 
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¢ The National Aeronautics and Space Administration 
Task Load Index (NASA-TLX) Is a well-validated tool 
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Introduction Results Conclusions 


The Burn Intensive Care Unit (BICU) is a complex e Surveys were returned from 129 clinicians across all sites (19 physicians, 87 nurses, and 23 others).(Figure 1) ¢ This is the first report using the T-TPQ to evaluate 
care environment requiring a large multidisciplinary perceptions of teamwork in the BICU. 


team to achieve optimal patient outcomes. ¢ We found no significant difference between clinician groups, sites, or years of experience in perceived teamwork. 


e Clinicians had a high degree of perceived teamwork (Table 1) 


¢ The T-TPQ had good to excellent internal consistency and reliability for all scales (Cronbach's alpha: .85-.92, ¢ Clinicians at all three sites gave highly favorable 


Good teamwork may improve patient outcomes. 


The Team Strategies and Tools to Enhance 
Performance and Patient Safety (TeamSTEPPS) is 
a validated survey to assess perceptions of 
teamwork amongst clinicians.° 


Table 2). 


Table 1. Means Scores and Standard Deviation of Each Perceived Teamwork Construct with Standard 


Leadership | Situation Monitoring | Mutual Support 


Deviation Based on Clinician Type 


Clinician Type | Team Structure 


perception ratings for all aspects of teamwork 
evaluated. 


The T-TPQ is a valid tool to measure teamwork 
perception in the BICU. 


In this multicenter study we sought to measure Physicians 28.64+3.68 28.45+3.28 28.95 + 4.17 30+ 3.83 29.1+ 3.88 These results seem to suggest that teamwork in the 
teamwork perception at three burn center ICUs. 
ni Nurses Fe Boy ees es 27.25 + 3.46 28.41+ 3.86 28.65 +/- 3.38 ali iceland ales 
ICU environments. 
Others 9771+ 46 | 2833+ 5.66 28.83 + 3.9 27.83 + 4.45 29 + 3.16 


Objectives 


Measure perceptions of teamwork among different 
clinicians in three different BICUs 


Table 2. T-TPQ Cronbach's Alpha 
Reliability Coefficients 


Teamwork Construct | Cronbach’s Alpha 


Determining the underlying reason for better 
perceptions of teamwork found in the BICU may be 
used to improve teamwork and therefore patient 
outcomes in other ICU settings. 


Team Structure 0.83 Acknowledgements 
Leadership 0.90 Nicole W. Caldwell, RN Research Coordinator at the 
Methods ae es USAISR for her unparalleled and dynamic regulatory 
—= ituation Monitoring . . 
We administered the TeamSTEPPS-Teamwork support and guidance; 
Perceptions Questionnaire (T-TPQ) to clinicians in Mutual Support 0.82 
three American Burn Association verified regional ee ee Agnes Burris, RN, Senior Research Nurse, and 


referral BICUs as part of an Institutional Review 
Board approved study. 


Admission rates from each site ranged from 270 to 
300 patients per year, with an average daily census 
between 2 and 5. 


Clinicians surveyed included: physicians, nurses, 
and “others” (therapists, pharmacists, and staff not 
part of any other group). (Figure 2). 


Experience data collected and grouped as <5 
years, 5-10 years, and >10 years. 


Scoring: A total score was calculated for each 
teamwork construct. Teamwork scores were 
dichotomized as acceptable for scores greater than 
3 and needs improvement for scores less than 3. 


Wilcoxon’s nonparametric method for comparisons 
was conducted to compare the clinician types, sites 
and years of experience. 


m@ Doctors 
m@ Nurses 


™ Others 


Figure 1. Breakdown of Surveyed 


Staff Across All Sites 


Figure 3. Breakdown of 
TeamSTEPPS Team 
Competency Outcomes 


Figure 2. Example of multidisciplinary rounds by the burn 
care team, which includes physicians, nurses, dieticians, 

physical and occupational therapists, respiratory therapy, 
wound care coordinators, and social workers. 
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Introduction 


Medical care in the burn intensive care unit is complex and 
challenging. 


Checklists, support clinical decision making and 
communication 


Checklist tools must be ecologically valid, they must 
represent the work domain that they support in order to be 
effective 


We combined quantitative and qualitative data to create a 
valid evidence-based tool to enhance communication and 
provide clinical decision support. 


Objectives 


To understand the work domain in the Burn ICU 
To create ecologically valid checklists 
Implement the Phases of Illness Paradigm 

To validate the Phases of Illness Paradigm 


To further develop the Phases of Illness Paradigm 


Methods 


{/ — POIP 
( Hypothesis 


Card Sorts 


Feedback 


Tool 
Prototype & 
Workflow V2 


Pilot Tool and 
Workflow V2 


Tool 
Prototype V1 


Pilot Tool and 
Workflow V1 


Analysis 


6 Months 


6 Months 
Retrospective review process 


impact, patient outcomes, 
staff satisfaction 


Figure 1: Methodology Model;Key: G1— Group Interview 1; 


G2—Group Interview 2; G—Group Interview 3 


Demographic data also collected 
Delphi: Process to obtain group consensus 


¢ Fifty-five clinicians participated in card sorts that were validated by all clinician types 


(Surgeon, nurse, respiratory therapist, etc.) in 3 group interviews. 


Sickest Patient/Could Die Toda Least Sick Patient/Could Transfer 


Figure 2: Feature Card Sorts 


Card Sorts 
7/7 Patients, 169 Card Sorts 


Site 1 Site 2 Site 3 
Patients Sorts Patients Sorts [Patients Sorts 


Unique | 19) | 60 173883 


Table 1: Card Sort by Site and Severity of Illness 


Sorts by Clinician Type 
Site 2 
73 36 
Least Middle Most | Least Middle Most 
= 2 


Site 1 Site 3 


60 
Middle 


Least Most 


Attending 


Nurse | 3 
Other | 7 
Phys Train 4 


Table 2: Card Sorts by Site and Clinician Type 


¢ Senior staff (>10 years of experience) and key leaders participated in the Delphi 
process. 


Make a noticeable “X” ANYWHERE the scales below that indicates the 
patient’s current treatments. 


Identify the patient's 
current Treatments 


**Text in each section is organized by objective/goal in bold type, 
recommendations in regular type, and considerations in italic type. 


2. Nutrition 


Goak Minimize loss of lean mass 


3. Monitoring 


Standard monitoring (Tele, S902, 
RR, NBP} Plus: 


4. Rehabilitation 


Progress 
: to March/Wsik -> Gym & Outside! 
Other care is important ikely more important Rehab most important, DO NOT DELAY 


Figure 3: Delphi Tool 


Results 


SSD | Gea 


a 


— tomy, | aoe ————— 


<3 


¢ We created two artifacts (tools) based on the data analysis: an at-a-glance (Team View) 
Summary and a contextual conditional scales tool (Nursing Severity of Illness Assessment), 
posted outside each patient’s door. Each site created unique tools. Site 1 shown here. 


¢ The Team View is a communal display of coordinating activities that provides a longitudinal 
view of patient severity of illness, plan of care, daily treatment goals and the status of quality 
metrics such as bundle compliance. 


Work Flow 


Bedside nurse updates 
Team View SOI 


Team updates daily 
treatment goals and plan 
of care 


Any team member can 
use the board to improve 
understanding of patient 
condition 


Figure 5: Team View Workflow 


Work Flow 


Bedside nurse assesses 
patient: determines SOI 


Off-going nurse uses 
assessment for shift report 
communication 


On-coming nurse uses 
assessment to make 
treatment suggestions 


Team View Patient Severity of Illness, Status, and Goals 


Severity of Illness (cransfer from condition 


assessment tool) 


1 1 1 1 1 1 


Antibiotic(s Effective Start Date Planned Stop Date 


Goals (completed during rounds) The most important goal(s) for today (what we must do to be successful): Priorities: 


Fluid volume goal for today: ___ Wound Care 
L] Positive — 
OJ Negative ___ SH/BT 


LJ) Even= + Other 


Procedure(s) 


Page 41: Nursing liiness Severity Assessment 
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VAULT UVTI UAAUALAUUIN il MT 
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Figure 6: Nursing Illness Severity Assessment Tools and Workflow 


Conclusions 


¢ Mixed methods clinical research in the ICU provides a deeper understanding of the ICU as 
a work domain and can produce ecologically valid tools to support ICU clinician cognitive 


work 


Effective checklists create shared mental models, improve team communication, and may 
improve patient outcomes by improving priorities of care 
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Introduction 


e The condition of each patient in the burn intensive 
care (BICU) Is typically complex and requires 
comprehensive care from a diverse and robust 
multidisciplinary team 


e The care team must communicate the daily care plan 
effectively so that all team members understand the 
patient's daily goals 


Care plans built upon a shared mental model provide 
care that is consistent, efficient, and able to meet the 
needs of the patient, resulting in good patient 
outcomes 

Often, individual BICU clinicians caring for the same 
patient have different perceptions, or mental models, 
about the patient condition and treatment priorities 
Differences in patient perception by members of the 
team reflect a lack of common ground and may 
impact effective teamwork and patient safety 

¢ Card sorts are research tools that reveal human 
perceptions about information? 


Objectives 


¢ As part of a larger prospective observational study to 
create decision support tools and test the Phases of 
Illness Paradigm? in three burn ICUs, we sought to 
understand the different mental models that 
individual BICU clinicians have about their patients 


¢ We sought to understand what differences in 
perception exist within the care team to reveal and 
understand how they might affect care decisions 


e The result is an understanding of clinician perception 
differences that will impact the creation of 
communication tools to enhance team perception 
and improve patient care 


We used Q-Methodology, or card sorting, to elicit how 


clinicians think about their patients 


We used 97 cards: 67 features and 30 treatments 


Clinicians were asked to identify a patient's condition 


on ascale from "could die today" to "could transfer 


today” 
| | | The least 
The | ! — sick ICU 
sickest : | patient: 
patient: | | Could 
Could ! 10 9 8 7 6 | 5 4 3 | 2 1 | Transfer 
Die | | tothe 


Today | ! ! ! ; = 
y ! ! today 


Figure 1: Severity of Illness continuous scale 


¢ 169 card sorts, 77 patients 

¢ Average time: 35.5 + 15.8 min [10-100 min] 

e Average # Feature Cards: 9 + 2 cards [3-16] 

e Average # Treatment Cards: 8 + 2 cards [3-14] 

e Figures 3 and 4 demonstrate differences in clinician 
perception of SOI on same patient 


Figure 4: Differences in clinician perceptions of illness on patient B 


e Perception of Illness Severity see graphs 1 & 2 


¢ Greater distribution amongst clinicians in the middle sick 


category 


Standard Deviation of Clinician Perception of Illness Severity by average 
Perception of Illness Severity 


Average Perceived Illness Severity of Patients on whom at least 5 
sorts were performed 


Graph 2: Average scores of patients with at least 5 sorts 


Methods 


Cards were selected and arranged by priority 


Most Important Least Important 


Most Important Least Important 
Figure: 2 Example of Card Sort with cards arranged from most to least important 


Results 


¢ Word Clouds graphically display the mental models see 


figures 5, 6, and 7 


e There are differences amongst different clinician types 
e There are differences between clinicians in the same 


profession see figures 5 and 7 
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Terms were analyzed by frequency in category, 
clinician type, and compared between institutions 
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Discussion 


e We can reveal the differences in the way we 
think about our patients using card sort 
methodology 


¢ We can use this information to expose 
differences and create tools to mitigate these 
differences and improve communication 


Limitations 


e Available cards may limit clinicians to only the 
cards that are presented despite having blank 
cards available 

¢ Small sample 


e May not be generalizable to other non-burn 
ICUs 


Conclusions 


¢ Burn ICU clinicians have different perceptions 
about patient condition and treatment 
priorities 


e The card sort method successfully elicits 
mental models from clinicians during routine 
daily activity 


e These models vary according to patient 


illness severity, clinician type, clinician 
experience, and institution 
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Introduction 


Focus groups are a source of social knowledge, 
and represent a way to collect data interactively 


We used focus group interviews to validate 
checklist tools using the Phases of Illness 
Paradigm (POIP) model 


The POIP is a model that defines patients by 


severity of Illness (SOI), aligning patient condition 


with treatments, with the intent of improving 
patient care by improving team understanding of 
patient condition, and team communication 


This study aimed to validate the POIP model and 
improve team communication through the 
creation and use of checklist tools 


Methods 


This was a prospective mixed methods study in 
three academic regional referral Burn ICUs 


Convenience sample focus group sessions were 
conducted using case studies and semi- 
structured interviews 


The case studies were of patients in 3 SOI 
categories: most sick (could die today), least sick 
(could transfer today), and middle sick (all others) 
see figure 1 


Clinicians identified how sick the patient was 
along condition scales and rank ordered the 
treatments they felt were indicated for the patient 
that day 


The process was repeated using the POIP 
checklist tools 


We identified the differences between no tool and 
tool 


We used thematic analysis to identify codes and 
themes, we then used these data to update the 
POIP tools 


Results 


¢ We found no significant differences in determining SOI with or without tool use (n= 28 participants; 


6 groups) 


¢ Although statistical significance was not found, clinically important differences SOI ranking were 


observed and discussed 
¢ 34% of clinicians changed their initial SOI score after using the tool 


¢ Clinicians chose SOI rank based on several themes 


¢ Overall Picture: the patient's entire status, not just one element 
¢ Includes premorbid condition and patient history 
¢ Timing and Tolerance to Treatments: whether or not the patient should be better at a moment 
in time 
¢ Includes the assumption of what the patient ought to be doing at a moment in their hospital 
stay 


¢ Interviews suggested that the POIP tools might improve care prioritization by improving 


communication about patient SOI 


Figure 1: The Phases of Illness Severity of Illness Scale 


Most Sick, could die today Least Sick, could transfer today 


Table 1: PRIORITIES OF CARE BY SEVERITY OF ILLNESS 


SOI ~=LABS MON MV ACC MEDS CRRT A&S NUT SLEEP REHAB 

6 3 4 3 
5 3 

> 3 

3 3 

6 4 

> 3 

3 3 

6 5 

6 6 

6 6 

6 


LEGEND: SOI: Severity of Illness; LABS: lab draws; MON: Monitors; MV: Mechanical Ventilation; ACC: Venous Access; MEDS: Medications; CRRT: Continuous Renal 
Replacement Therapy; SLEEP: Sleep; WC: Wound Care; REHAB: Rehabilitation. 


Discussion 


Clinicians alter care priorities according to their 
perception of patient condition (SOl). 


Using a checklist tool to determine patient 
condition helps clinicians identify SO! more 
consistently. 


A shared understanding of patient condition and 
care priorities may improve communication, 
planning, and resourcing of patient care. 


Group interviews facilitated tool development by 
establishing end-user ownership and buy-in 


Clinicians prioritized care similarly based upon 
SOI, further validating the POIP model of care for 
use in the ICU see table 1 


Limitations: we did not audio/video record or 
transcribe the sessions 


Conclusions 
¢ Clinicians identified SOI according to their 
perception of overall patient condition and 
current trajectory 
¢ Temporal and historical factors play important 
parts in determining how clinicians think about 


their patients and how they prioritize care 


¢ Understanding team perception may improve 
communication and patient safety 
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Introduction'> 


Communication is a fundamental aspect of 
teamwork. 


Ineffective communication remains one of the 
leading causes of medical errors. 


People often assume their words convey an 
intended meaning. 


Descriptive terms that clinicians of different 
Specialties and backgrounds choose are 
sometimes misunderstood or interpreted 
incorrectly. 


Effective teamwork requires a shared mental 
model of patient status, team resources, and 
goals that all team members understand, and, 
more importantly, support. 


Objectives 


We sought to learn if there is any correlation 
between different clinician's perspective of 
patient illness severity and the terms they use 
to describe a patient's condition. 


Methods 


This was a prospective, mixed methods study 


(Survey plus interview) of clinicians in three 
academic, regional referral Burn ICUs. 


We asked clinicians during normal daily 
activities to identify terms they might use to 
describe “how sick’ their patient was, or to 
offer their own terms. 


We also asked clinicians to identify “where” 
their patient was on a 1-10 scale indicating 
illness severity where scores of 1-3 indicated 
‘least sick, 4-7 indicated “middle sick,” and 8- 
10 indicated “most sick.” 


We describe our findings using a contour plot, 
average illness severity per term, confidence 
intervals, and a “strength within group” 
Statistic (the frequency a term is chosen within 
an group less its frequency chosen in other 
groups). 

This study was conducted under a protocol 
reviewed and approved by the US Army 
Medical Research and Materiel Command 
Institutional Review board and in accordance 
with approved protocol 


Results 


We performed surveys and interviews with 169 clinicians caring for 77 unique patients: 25 staff 
physicians (“attendings”), 61 nurses, 40 residents, and 43 clinicians in other roles. 


clinicians in other roles chose 6+2 descriptors. 


8% of respondents added the following novel terms (with corresponding illness severity scores) 
not otherwise identified in pilot interviews: looks well (1), resource limited (2), just extubated (2), 
slightly combative when not sedated (3), geriatric patient (4, 4, 6), long-term rehab (5), wound 


infection (6), significant lung issues (6), poorly oxygenating (6), not ready for transfer (7), chronic 


critical illness (8), tenuous (9), critically ill (7 ,7, 9) 

There is a trend of terms that describe a patient's illness severity (figure 1). 
A priori analysis demonsirated that: 

— “Not sick” was chosen exclusively, but infrequency, for least sick patients. 


— “Shock like” and “actively trying to die” were chosen exclusively, but infrequently, in the most sick patients. 


— No term was chosen exclusively within the middle sick illness severity group. 
— “Ready for Transfer’ had the strongest strength within group statistic and lowest average illness severity. 


3 


—- Three terms — “most interventions, 
an illness severity above 8 and had strength within group statistics of > 20%. 


the work “profound would be notable for describing the most sick patients. 
Confidence intervals for terms widely overlap illness severity scores (data not shown). 
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Figure 1. Contour plot showing the frequency of terms chosen according to patient illness severity as indicated by clinicians. Percentage = the 
count of a term divided by the number of surveys/illness severity score. Also shown are the number of times a term was chosen overall (term 
count), the mean illness severity for which a term was choses (mean severity), and the difference between the frequency a term was chosen 
within the A Priori Group (least sick = 1-3, middle sick — 4-7, most sick = 8-10) and Final Group (where most sick = 7-10) vs. outside the group 
strength within group). This statistic helps differentiate terms that are used often (i.e. by many clinicians) and are consistent with a particular 
illness severity group. Of note, illness severity in reality is not discrete: it represents a continuum of patient condition. Here, we try to 
demonstrate that with a gradient of color whereas in the analysis we uses three discrete groups. 


k= 


On average, attendings chose 5+2 descriptors, nurses and residents chose 4+2 descriptors, and 


multiple organ failure,” and “the sickest patient” — were consistent with 


If the most sick group included illness severity scores of 7-10, two additional terms, both including 


Discussion 


¢ Clinician terminology poorly differentiates 
patient illness severity, although a general 
trend in terminology exists. 


¢ Terms that indicate extremes of illness 
differentiate between most sick and least sick 
Burn ICU patients, but have limited 
differentiation between these groups and 
middle sick patients. 


¢ Changing illness severity groupings changes 
the strength within group statistic, but does 
not change conclusions significantly. 

¢ Limitations: 


- This was not an exhaustive list of terms: clinicians 
may have anchored to the terms presented 
instead of using their own terms. 


— Patient illness severity is a continuous variable, 
yet we have analyzed it discretely. 


Conclusions 


¢ Lack of a shared understanding with respect 


to patient condition degrades teamwork and 
increases risks to patients through 
dyssynchrony of care. 


¢ Improving team understanding about patient 


condition by standardizing descriptive 
terminology might improve communication 
and patient care. 
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Introduction Results Discussion 


¢ Multidisciplinary teams in the burn intensive ¢ We surveyed 48 end-users (response Overall satisfacti) I ¢ Creating tools to support clinical work 
care unit (BICU) are large, comprised of rate?) (Physicians: 3; Nurses: 30; : requires frequent feedback from end users in 
clinicians trom multiple different clinical Others: 15) Improves patient outcome HTT order to produce a tool that is ecologically 
backgrounds’ ¢ Two tools were created, see figure 2 Improves patient care [TTT valid and useful 
the care of the critically ill burn patient’ 3.23 (SD 0.98) Adequate Training interfered with work, but also did not think the 
© SRN or ne taapip mew one Senne — Fewer participants rated very low/low 0 SS eS ee Se s ateibadhenen 
tools to support clinical decision making for the , 1.. 
critically ill28 patie Deesassesesaie sabia ae very improves my understanding. - Using this data, we shifted the burden of tool 
sclakdgs sdehahmesiabragnian oral SSSSSEz , | 
- In order for tools to be useful, they must be those that were neutral (35%) a Tae SAT rset fiance aati and team 
Ecologically Valid- or represent the work = — Comfortable with using HTT, | g p y 
domain they intend to support?" ~ Physicians were more satisfied than : - Daily use of the TeamView has been more 
ete mer Se tan (n =3) vs. Easy to use I! routine since that time. 
% dissatisfaction (n= , : 
Theoretical Underpinnings ° | | | It Interferes with my work Hi | 
| —— +see graph to ghiior combined scores Conclusions 
¢ The Phases of Illness Paradigm (POIP) is a {n=48} te 3.0 a. : 
theory that defines patients by severity of illness ¢ The POIP checklist tools supported teamwork 
(SOI) and aligns treatment to patient condition Figure 2: Two tools The TeamView board is located outside and communication without interfering with 


workflow for most participants 


¢ Decision support tools based on the POIP Burn Illness Severity Assessment tool each patient's room a 
enable shared mental models which enhance A. Clinicians assess patient along 6 E. Clinicians update the daily SOI along * After 6 months of use, most Clinicians were 
communication, efficiency, and care delivery. continuous scales the top rainbow patterned area comfortable with the tools yet daily use was 
Figure 1: The Phases of Illness, Severity of Illness Scale B. Clinicians determine SOI and make a F. Daily events: tube and line changes lower than expected 
mark along the rainbow patterned scale are tracked below - We used this data to update tools to improve 
= £3332 C. Treatments are checked off along each G. There is space for messages, and use for both 
Most Sick, Least Sick, of the 12 scales antibiotic start and stop dates are A 
i er cknowledgements 
could die today could transfer today A Clinicians assess the tracked g 
appropriateness of treatments for H. On rounds, the care team updates ¢ We would like to thank Nicole Caldwell, BA-RN, for 


the SOI category her help with this poster, regulatory support, and 


Objectives the overall daily goals & fluid goals guidance 
¢ We sought to create ecologically valid clinical I. Priorities of care are determined and ¢ Thanks to the clinical staff who participated in this 
noted on the board study 


decision support tools for the BICU based 


up on the PO] P mo d Q| Team View Patient Severity of Illness, Status, and Goals 
Severity of Illness (cronsfer from condition assessment tool) Allergief sd Code Statuy 
somo] —, i eae ee A A a ee References 
Methods 3. 
eiiameeeaien 1.Herndon, ed., 2007. Chapter 2: Teamwork for Total Burn 
¢ This was part of a prospective mixed methods C. jeri nscamn ngayon | care Total burn care third edition, 
Study In three academic regional referral Burn cn ye T : See ae eiila ry 2010, Process Improvement data collection...Crit 
CUs Hu es 3.Pronovost 2006, An intervention to decrease...N Engl J Med 
e After the first 6 months of tool use, we d Te “ 4.Haynes 2009, A surgical safety checklist...N Engl J Med 
assessed user satisfaction using a 10 en Pema H En SSeS ee eee sched daabeiiaaial biti head haa 
question 5-point Likert-like scale ere acecenteniemeatinatneian . — . sin = . _Effective Start Date_ jagnosis ia 2011, Prompting physicians to address. . Crit Care 
¢ Although intended to enhance team | 7.Narasimhan 2007, Improving nurse-physician comm...Am J 
communication, the burden of tool completion vatgiammmnmivnaase | UIE TET TEE TUTE ETE VETTE e sti an al(s r a at we mus e successful): Crit Care 
was placed on nurses. =a cal -_ 2 — 2003, Explicit approach to rounds...Intensive Care 
a Poe inmrm C) Negative L ___ Extubation 
@ For statistical analysis We reduced the scale ATA yyy wo gy CL] Even= + L ee 9 Hales 2008, Dev of med checklists. 7 Int J Qual Health Care 
from 5 points to 3 points: agree, neutral, and 10.Winters 2009, Clinical review: checklists...Crit Care Med 


disagree 


This study was conducted under a protocol reviewed and approved by the Brooke Army Medical Center Institutional Review board and in accordance with approved protocol. 
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Introduction Methods Discussion 


¢ Critical care of burn patients requires a multi- ¢ This was part of an IRB approved, prospective, mixed ¢ To identify the impact of these tools on the mental - The process of developing tools that identify 
professional team of clinicians methods study to understand clinician perspectives about models clinicians form about patient condition, we asked clinician perception about patient condition and 
patient condition and treatment priorities clinicians to identify their patient's current and anticipated treatment priorities changed how clinicians consider 
- They must effectively collaborate in order to ensure condition on the following day by marking a continuous patient illness before these tools were introduced to 
optimal outcomes ¢ This understanding was used to create tools that could scale from “Most sick/Could die today” to “Least the BICU (pre-baseline to baseline) 
| | improve clinician decision making, teamwork, and sick/Could transfer from the ICU today” 
¢ Effective teamwork necessitates team members communication according to the Phases of Illness ¢ Introducing a burn illness assessment tool 
share common goals Paradigm ¢ Continuous scales divided into ten equal parts and the developed through a mixed methods research 
_— | location of a clinician’s mark upon them was scored from further improved agreement between Clinicians 
¢ Establishing goals requires a shared mental model * Clinician perspectives were elicited through survey and 10 (most sick) to 1 (least sick) about patient condition 
of a patient's current condition, anticipated future card sort methodology 
State, and treatments to bridge the two © We then evaluated the variance of the differences ¢ Improving the team’s perception of a patient's 
| _— * Tools were created through using data obtained from between clinician perspective before beginning the current and future state has the potential to improve 
* Better understanding of how clinicians understand card sort (see figures 1 & 2) and refined by focus groups, project (pre-baseline), before implementing tools teamwork by creating a better, shared mental model 
patient condition, and ultimately treatment priorities, the Delphi process for consensus building, and pilot (baseline), and six months after implementing tools of the patient and care priorities 
could improve teamwork, communication, and testing 
patient outcomes ¢ Patient care outcomes are likely improved by better 
Results teamwork and improved team communication 
regarding patient illness severity, daily goals, and 
¢ The average variance reflecting clinician perception of a patient's current and anticipated condition was as follows: treatment priorities 


¢ pre-baseline, +1.73 and +1.37 see graph below 


Objectives | Conclusions 
" ia duet i eae ¢ baseline, +1.38 and +1.33 —C OO 
¢ We sought understand how a team of clinicians . os ¢ Developing and implementing tools according to the 
perceive patient condition, and measure the impact six months, + 0.7 and £0.76 Phases of Illness Paradigm resulted in improved 
of a burn specific illness severity assessment tool ¢ The decreased variance for both current and anticipated condition was statistically significant at each time point clinician agreement about patients’ current and 
on team understanding (ANOVA, P = 0.01) anticipated condition 


¢ These tools can help clinicians asses a patient's 


Variance in Reported Perception of Patient Condition current condition and anticipated best treatments 


© Current Condition &@ Anticipated Condition 
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Introduction Results Discussion 
- Patient care in the burn intensive care unit (BICU) — + Overall, there were 169 responses from 60 respondents goals. Only 95 responses (57%) met * This data suggest clinicians may have widely 
Is complex and involves large multidisciplinary the definition of goal (example below, table 1) different beliefs about patient condition and care 
teams a we 
| — The most common goals were are shown in figure 1 pone 
* If team members are not working toward common - Only six patients had at least three clinicians that responded. Comparisons between - Of the top care 4 goals identified by clinicians 
ie allan pe nhipelnhtisnea to clinician responses for this six patients showed: most were not shared by other clinicians 
and ultimately patient safety may be compromise _ 920) 4/. 470 ‘oriti a | 
¢ The Phases of Illness Paradigm (POIP) Is = mie ae f vibes aes ore son state braee nts wh re “most sick” than in patient senor. saci Sse 
e Pha aradigm ( jisa iniclans perceive ore consistently in patients who were “most sic an in patients patients and decreases care efficiency, 


theoretical model that defines patients by severity who were “middle sick” (figure 2) 


of illness, aligning patient condition to treatments 


¢ Understanding how clinicians perceive patient 
condition and associated care goals is necessary 
to develop ecologically valid tools to support their 
daily work 


coordination, and synchronization 


Table 1. Example of raw and coded data. « Interestingly, the majority of coded goals (66% in 


Original Coded Coded Utterance each SOI group) could be represented by a small 
Category Category 


number of themes 


Maintain oxygenation and Adequate oxygenation and/or ¢ Identifying common goals — and care plans, 
reer a protocols, or pathways around them — for different 


Goal =| Skin grafting Objective | Surgical operation (implicit goal = patient types, whether according to patient SOI as 
achieve wound healing) 


in this project, or by some other grouping (i.e. 
disease process), should improve patient care by 


Objective 


¢ To understand how clinicians perceive patient 


Adjudication occurred by majority vote 


Fig 1. Coded goals in middle and most sick patients 


degree to which individual team members share 2 8 t 120%, 
the same mental model of the patient | Conclusion 
Methods s 100% * Clinicians in the BICU do not share a common 
Sarai mental model of patients or care priorities 
¢ A*Condition Understanding Survey” was created re & S & & ee ee ee ee 
ee e £ FF FF SF 0 : 
to assess Clinician’s perception of the Patient's FF Fe oS 80% aesidel < ail asda ead = ove — 
Severity of Illness (SOI) and associated care goals Fig 2. Reported sickness . | p | 
severity levels (mean ; performance, patient care, and ultimately patient 
- Surveys were administered during normal patient with range) 60% outcomes 
RS Kine. Os Sen ee We Sere Be ¢ This might be accomplished by creating protocols 
- rate patient SOI on a 10 point scale from “most 40% - tivnas loniimed an tn seawien P 
ae ee eee $1, complexit as Nestea O ortunit i Hilecues 
- prioritize goals of care 20% differences ee , 
O 
¢ A goal was defined as “a near-term desirable 
outcome for the patient. There may be more than 0%, Acknowledgements 
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This study was conducted under a protocol reviewed and approved 
by the Brook Army Medical Center Institutional Review Board and in 
accordance with the approved protocol. 
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Introduction: 

Multidisciplinary rounds (MDR) in the Burn Intensive Care Unit serve as an efficient 
means for clinicians to assess patient status and establish patient care priorities. Both 
tasks require significant cognitive work, the magnitude of which is relevant because 
increased cognitive work of task completion has been associated with increased error 
rates. We sought to quantify this workload during MDR using the National Aeronautics 
and Space Administration Task Load Index (NASA-TLX). 


Methods: 

Research staff at 3 academic regional referral burn centers administered the NASA- 
TLX to clinicians during MDR. Clinicians assessed their workload associated with 1) 
"Identify[ing] if the patient is better, same, or worse than yesterday" and 2) "Identify[ing] 
the most important objectives of care for the patient today." Data were collected on 
clinician type, years of experience, and hours of direct patient care. 


Results: 
Surveys were administered to 116 total clinicians, 41 physicians, 25 nurses, 13 
medical students and 37 clinicians in other roles. Clinicians with less experience 
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reported more cognitive work when completing both tasks (p<.005). Clinicians in the 
"others" group (respiratory therapists, dieticians, pharmacists, etc.) reported less 
cognitive work than all other groups for both tasks (p<0.05). 


Conclusions: 

The NASA-TLX was an effective tool for collecting perceptions of cognitive workload 
associated with MDR. Perceived cognitive work varied by clinician type and 
experience level when completing 2 key tasks. Less experience was associated with 
increased perceived work, potentially increasing metal error rates and increasing risk 
to patients. Creating tools or work processes to reduce cognitive work may improve 
clinician performance. 
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ATTENTION OF 


10 July 15 
Dear Dr. Gamelli, 


Thank you for accepting and allowing us to revise again our manuscript JBCR-D-15-00153, entitled 
"Comparing the workload perceptions of determining patient condition and priorities of care among 
burn providers in three burn ICUs." We are greatly appreciative of the thoughtful commentary by your 
reviewers which again has improved the quality of our manuscript. Individual responses to your 
reviewers concerns are below. 


| hope these revisions adequately address your concerns. Please do not hesitate to contact me directly 
if there is anything | can do to help facilitate review and/or revision. 


Kind regards, 


JEREMY PAMPLIN, MD, FCCM, FACP 
LTC, MC, USA 

Medical Director, Burn ICU 
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Reviewer #2: 
| detected one remaining typo. In the revisions on page 12 there is a statement "....least about of total 
cognitive work..." 


- Corrected. Thank you. 
| believe the revisions have improved the paper. There will always be criticism of data from a 
"convenience sample of volunter subjects" but | believe the alternative of mandating completion of the 
data forms from every participant in rounds would result in some forms being filled out superficially just 


"to get them done". The latter option would not necessarily produce more reliable data. 


- Thank you. 


Reviewer #3: 

The authors have substantially improved their manuscript. As indicated in my earlier review, | cannot too 
highly praise this paper. It will have significant impact on the human factors describing burn care and will 
likely trigger new directions in the organization and delivery of care in burn centers. The suggestions 
below are meant to improve an already excellent paper and to answer a few questions that continue to 
intrigue me. 


- Thank you. 


First, | would like to emphasize that the ICU experience is only a small portion of the total treatment of 
"burn disease". It appears to me that the authors view burn critical care as an isolated and nearly 
independent part of burn care, even to the point of suggesting the ICU staff should be formally separated 
from the post-injury courses of burned patients. Whether increased fragmentation of care proves to be 
beneficial to patients remains to be seen, but the authors' methodology will likely be the best way to 
measure these effects. 


- We agree that the ICU experience is only a part of a burn patients’ overall burn care. We did not 
intend to imply that the ICU experience nor the clinical teams should be separated. We 
certainly did not study this nor did we present data about this. In all of the centers involved in 
this project, clinicians representing all locations of a patient’s care (ICU, Ward, Clinic) and all 
professions contributing to it (intensivist, surgeon, RT, rehabilitation (OT & PT), social work 
services, nursing, nutrition, etc.) participate in patient care. Unfortunately, our convenience 
sample was not able to obtain data from all of these clinicians types. 


Admittedly, the study sample is quite small, especially in relation to all of the pertinent variables 
involved. Much more data will be needed to potentially eliminate some of the non-normal distributions. 
The "other" group is particularly problematic, in that this group is overwhelmingly composed of the more 
experienced clinicians, particularly for the clinicians who may be "too old" to work ona burn unit. The 
fact that only one OT represents the Rehab disciplines is eye catching. As one of the pillars of the ABA, 
the lack of representatives of Rehab group is of concern - does the sample represents the distribution of 
the "other" in the individual units? 


- No, our study distribution of “others” does not represent the actual distribution of “others” 
caring for patients in the burn center. Our primary target population was nurses and physicians 
in this protocol since these groups represented the largest proportion of clinicians caring for 
burn patients on any given day. Also, these groups have the greatest distribution of experience 
for us to examine. 


Table 1 lists n = 11 burn surgeons, but the subgroups add to 31. 


- Great catch! Fixed. 


Further, are none of the burn surgeons surgical intensivists? 


- Wedid not collect this data specifically in this project, but the majority of the burn surgeons in 
this project were also surgical intensivists. We have added the term “medical” before intensivist 
throughout the manuscript for clarification. 


In the same table, is "average experience" the duration of medical training or the time spent in burn 
centers. 


- This was the time since graduation from licensing school or year in school for students. We have 
added this information to the manuscript. 


If the figure represents time since medical school graduation, a separate column indicate full time burn 
center assignment should be provided. 


- Unfortunately, we did not collect this information. 


Particularly in the military burn center, many of the assignments are short term (less than 5 years) 
rotators. 


- Agree. 


| feel strongly that the military burn center should be identified by site - is it site 2 ?? 


- Weare uncertain as to how we should respond to this request. We do not feel that including 
this information will add additional insight to the manuscript. The military center was not site 
2. 


In particular, if it is site 2, as is my guess, | think the authors have made a phenominal observation about 
the remarkable effectiveness of the military philosophy of education and leadership that would be 
beneficial to resolution of many of the shortcomings suggested in this study. The authors might concult 
Dr Gamelli to see if this would be acceptable. 


- No response. 


This reviewer would be a member of the "> 10 yrs" group. What's wrong with us? Should we leave 
clinical care or choose a new specialty? Hopefully, in the fullness of this research, you will be able to 
answer such questions. | should point out that many burn units have only a few daytime physician 
extenders and no residents. The attendings are on both attending call and resident call 24/7 and these 
duties certainly constitute workload. Could you better describe this group of clinicians? 


- Weare unclear as to which group of clinicians this reviewer would like us to describe (attending 
in general, clinicians with > 10 yrs experience, or attending that perform both “attending” and 


“resident” duties during a 24/7 call) and what constitutes “better?” We did not collect 
additional demographic information for any of these groups. 


Please better describe your statistical considerations and methods. You indicate that you used Wilcoxon 
and Steel-Dwass techinques. What's the difference? What does it mean when one method is significant 
and the other is not? What does it mean when both are significant? 


- We have edited the manuscript to reflect that we used the Wilcoxan Test with the Steel-Dwass 
correction and provided a reference. The Steel-Dwass correction provides a means to make 
non-parametric data appear more “normal” in distribution before performing statistical 
comparisons. When you use the Steel Dwass adjustment, you increase the p-value due to 
increases in the false positive rate. Therefore, Steel-Dwass is conservatively decreasing the 
chances of a type-1 error. The Steel-Dwass is less likely to be significant over just doing a 
Wilcoxon Test alone. 


Finally, | would suggest further emphasizing the utility of the NASA-TLX instrument as an effective 
instrument for assessing not just human factors but also for evaluation team effectiveness and maybe 
even adequacy of staffing in the burn center. For example, was there less frustration at site 2 because it 
had a lower average census? 
- These are thought provoking observations. Unfortunately, we did not collect data to address 
these considerations in this project, but they represent great ideas for future study! 


There are a number of grammatical errors persisting in the manuscript, especially in the latter half of the 
Discussion. | would like to emphasize that the authors are excellent writers - the manuscript was a 
pleasure to read. Reference 11 lacks the name of its journal in the citation. As stated above there 
appears to be a numerical inconsistency in Table 1. 


- Wehave, hopefully, corrected all of the grammatical errors. 
- We have added the journal for the citation. 
- Table 1 has been corrected as above. 


My curiosity has got the best of me. What did Nicole Caldwell do for this paper? Given the potential 
magnitude of this work, she certainly deserves her recognition. 


- She facilitated our regulatory approvals and administrative support of this project. This has 
been added to the manuscript. 
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Title: Comparing the workload perceptions of identifying patient condition and priorities of care among 
burn providers in three Burn ICUs. 


Abstract 


Introduction: 

Multidisciplinary rounds (MDR) in the Burn Intensive Care Unit serve as an efficient means for 
clinicians to assess patient status and establish patient care priorities. Both tasks require significant 
cognitive work, the magnitude of which is relevant because increased cognitive work of task completion 
has been associated with increased error rates. We sought to quantify this workload during MDR using 
the National Aeronautics and Space Administration Task Load Index survey (NASA-TLX). 


Methods: 

Research staff at 3 academic regional referral burn centers administered the NASA-TLX to 
clinicians during MDR. Clinicians assessed their workload associated with 1) “Identify[ing] if the patient 
is better, same, or worse than yesterday” and 2) “Identify[ing] the most important objectives of care for 
the patient today.” Data were collected on clinician type, years of experience, and hours of direct 
patient care. 


Results: 

Surveys were administered to 116 total clinicians, 41 physicians, 25 nurses, 13 medical students 
and 37 clinicians in other roles. Clinicians with less experience reported more cognitive work when 
completing both tasks (p<.005). Clinicians in the “others” group (respiratory therapists, dieticians, 
pharmacists, etc.) reported less cognitive work than all other groups for both tasks (p<0.05). 


Conclusions: 

The NASA-TLX was an effective tool for collecting perceptions of cognitive workload data 
associated with MDR. Perceived cognitive worktead varied by clinician type and experience level when 
completing 2 key tasks. Less experience was associated with increased perceived work, potentially 
increasing metal error rates and increasing risk to patients. Creating tools or work processes to reduce 
cognitive worklead may improve clinician performance. 
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Task Performance and Analysis 
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Introduction 

The burn intensive care unit (ICU) presents a challenging work environment to the healthcare 
team. Effective care requires the coordinated effort of healthcare professionals from different 
backgrounds, each member contributing unique perspective toward a common goal. These teams are a 
necessity given the complexity of managing the medical, administrative, and social aspects of patient 
care. Multidisciplinary rounds (MDR) is an event that facilitates communication of relevant information 
among team members and is associated with better outcomes in the ICU.**? 

While MDR represent a powerful tool and a logical means for efficient dissemination of 
information, there is variability in the quality and effectiveness of such rounds. MDR must encompass 
key aspects of care, to include problems, plans, and goals. The multidisciplinary team must be 
effectively managed to ensure that all important aspects of patient care are addressed. Caution must 
also be taken to ensure that information is discussed clearly and in such a way that it is accessible to all 
efthe members of the team who need it; thus, helping to avoid the need for inefficient clarifications 
with individual team members after MDR have ended.* Input from all team members must be 
evaluated and integrated by the team leader, typically a physician, in such a way as to create a cohesive, 
prioritized care plan. * 

A series of decisions are made during MDR, some critical, some routine. Likewise the mental 
cognitive work that goes into making these decisions is variable. In the same way that physical work is 
defined in terms of distance and force, penta} cognitive work can be imagined as a function of a task 
and the perceived effort required to completeiag it. Different people weuld have different perceived 
workloads when completing the same task according to their familiarity with the task and their overall 
experience with the task or similar tasks.? Calculating workload by this definition requires 
quantification of perceived mental “force.” Hart and Staveland developed the National Aeronautics and 


Space Administration Task Load Index (NASA-TLX), a survey composed of six subscales, designed to 


assess perceived workload of NASA pilots. These subscales include mental demand, physical demand, 
temporal demand, frustration, effort, and performance as defined in the NASA-TLX Manuscript.° The 
NASA-TLX has been used broadly in aviation, the automotive industry, and more recently in medicine.© 

Lower perceived workload, as measured by the NASA-TLX, has been linked to better 
performance in medicine.*°"? Proper identification of a patient’s illness severity may also be associated 
with improved clinician performance. Starmer and colleagues demonstrated a significant reduction in 
preventable adverse events after implementation of a tool that increased communication of patient 
illness severity during change-of-shift handoffs.” 

Multidisciplinary rounds present a cognitive challenge: to integrate data, make diagnoses, 
prioritize care tasks, provide education, and to form shared mental models.** The magnitude of this 
challenge, however, has not been well defined-hewever. Also unclear are the differences in cognitive 
workload, if any, experienced by the different types of clinicians who participate in MDR. The current 
study sought to define the perceived workload associated with the completion of two important tasks 


during MDR: generating a personal assessment of overall patient condition and identifying the priorities 


ef for the day’s care plan. 


Methods 

We conducted this institutional review board approved survey study in three American Burn 
Association verified regional referral Burn ICUs. The NASA-TLX surveys were administered by research 
staff to clinicians at each site who participated in MDR during daily clinical practice according to the 
process outlined below. 

Admission rates to these Burn ICUs varies from 270 to 300 patients per year with an average 
daily census between 2 (site 2) and 5 (site 1 and 3). At each site, MDR are led by an attending physician 
who was either a burn surgeon credentialed in critical care (sites 1, 2, and 3), or a medical intensivist 
with extensive burn experience (site 1). Nurse to patient ratios vary among sites from 1-to-1.5 nurses 
per patient at site 1, to 1 nurse per patient at sites 2 and 3. Attendance at MDR varies, but typically 
consists of the bedside nurse, rehabilitation specialists, registered dieticians, clinical pharmacists, 


respiratory therapists, burn fellows, residents, and students. 


Multi-Disciplinary Rounds Conduct 


MDR typically consisted of a resident presenting the patient by systems followed by other team 
members providing additional pertinent details and recommendations as they felt appropriate. The 
attending physician would direct the information flow and sequence of rounds as he felt necessary and 
would elicit from the team and/or state a care plan for the patient. Additionally, site 1 used a daily 
communication tool completed by the unit’s “charge nurse” (e.g. nursing shift leader). This 
communication tool consists of a checklist that confirms use/absence of certain quality metrics (i.e. 
deep venous thrombosis prophylaxis, gastric ulcer prophylaxis, head-of-bed elevation, etc.) and a list of 
daily tasks that the charge nurse identified during rounds. At site 1, the charge nurse reviews the 
checklist and reads the identified tasks as the last activity of a patient’s rounds prior to the MDR team 


moving on to the next patient. 


Survey Administration: 


Research staff administered the NASA-TLX as asurvey-using either a paper (sites 1 & 3) or 
electronic (site 2) ##eaAs survey to a convenience sample of clinicians present on MDR for at least five 
discrete rounds events. A “discrete rounds event” was MDR rounds for a single patient. Thus, the 
NASA-TLX could be administered once per day for five days or five times in a single day for five different 
patients. Surveys were administered immediately after MDR was complete for a single ICU patient. 
Each site adjusted the survey collection period to meet the needs of their site and according to patient 
volume. Surveys were administered during different points in the MDR to account for physical and 
mental fatigue that may impact workload perception. For example, surveys were administered early in 
rounds (after the first patient), middle (after the middle patient) or late in rounds (after the last patient). 

Prior to administration of the NASA-TLX survey, research staff reviewed a consent document 
with potential clinician subjects who participated in MDR. Clinicians were not required to participate, 
but their participation implied consent. Subjects were allowed to quit the study at any time by not 
completing the survey. Incomplete surveys were not included in the data analysis. Participation was 
anonymous and no personally identifying information or master list of participants was collected. We 
collected participant demographics including clinician type, years of experience, and time spent in direct 
care of the patient. 

After the consent was reviewed and a copy provided to subjects, the research staff read 
directions aloud and then provided the NASA-TLX survey to participants. Time was provided for 
questions and clarification by the research staff. Clinicians assessed their workload associated with two 
tasks identified by the following questions: 1) "Identify if the patient is better, same or worse than 


yesterday" and 2) "Identify the most important objectives of care for the patient today." 


Statistical Analysis 


For the purpose of this study, we analyzed results according to the following groups: “physician” 
represents all attending physicians (burn surgeons or medical intensivists) who led or participated in 
MDR, as well as all physicians in training including those physicians who were part of a certified 
residency training program or fellowship; “nurse” represented all nurse types including licensed 
vocational nurses, registered nurses, and clinical nurse specialists; “student” represented medical 
students; and “other” represented clinicians not in any other category including respiratory therapists, 
dieticians, occupational or physical therapists, pharmacists, and psychiatry support personnel. 

NASA-TLX Scores were calculated as described by Hart?: weighted cognitive load was calculated 
by first determining individual subscale ratings for mental demand, physical, temporal, performance, 
effort, and frustration; reported on a scale of 0-100 by asking subjects to place a mark ona line divided 
into 50 equal parts. A researcher then converted this analog representation into a value from 0-100. 
Individual subscales ratings were given a weighting factor which represented the perceived importance 
of a given subscale relative to the other subscales. This weight equaled the number of times a subject 
selected the subscale over another subscale while completing the “sources of workload” portion of the 
NASA-TLX survey. During this portion of the survey, subjects were asked to determine which subscales 
were the more important contributors to workload according to a series of 15 pair-wise comparisons. 
Thus, a weight could range from 0-5 (0 meaning that a subject never chose the subscale compared to 
other subscales and 5 meaning the subject always chose a subscale when comparing it to other 
subscales). Individual raw subscale data were multiplied by this weighting factor and were then 
summed. This sum was then divided by 15 to yield the weighted (total) cognitive workload. 

The NASA-TLX survey scores were summarized using medians and interquartile ranges for each 
of the demographic groups. Due to the small sample size and lack of normality, the scores were 
analyzed using the nonparametric Wilcoxon's Test alene-and with the Steel-Dwass methed correction 


for multiple test correction.’ Significance was established when the p-value was less than 0.05. All 


analysis was performed using Statistical Analysis System (SAS) v9.2, SAS Institute Inc., Cary, USA or JMP 


v10.0, SAS Institute Inc., Cary, USA. 


Results 


Surveys were administered to a total of 119 clinicians across all sites; however three surveys 
were incomplete and were excluded from the analysis for a final n = 116. The median weighted 
cognitive load for task 1, identifying if a patient was better, same, or worse than the previous day (i.e. 
identifying the patient’s “severity of illness” or SOI), was 40 (IQR 13-67). The median weighted cognitive 
load rating for task 2, identifying the most important objectives of care for the patient today (i.e. 


“ 


identifying the patient’s “priorities of care” or POC) was 43 (IQR 18-68). Mental demand, temporal 
demand, performance, and effort all contributed more to the overall cognitive load than did physical 
demand or frustration subscales (table 1, figures 1-2). Perceived workload varied significantly according 
to clinician experience and professional background (figures 3-6), but not according to clinician location 
or time spent with the patient (data not shown). Interestingly, the frustration and physical demand 
subscales were particularly non-normal in their distribution across our sample. 40%-Forty percent of 
respondents reported no frustration and 63% of respondents reported no physical demand for 
identifying SOl. Numbers were similar for respondents’ perception of frustration and physical demand 
for identifying POCs: 38% and 62% reported zero frustration or physical demand respectively. 
Comparing perceived cognitive workload between clinician types revealed several significant 
differences (p < 0.05 for all comparisons, figures 3-4). Students, nurses, and physicians experienced a 
higher total cognitive workload than did “others” when identifying both SOI and POC. Students 
experienced more mental demand than “others” when identifying SOI and more than nurses and 


“others” when identifying POC. Nurses and physicians experienced more temporal demand than the 


“others” group when identifying SOI, while students, nurses, and physicians experienced more temporal 


demand than “others” when identifying POC. Students also reported increased effort associated with 
identifying SOI as compared to all other groups, and more than physicians and “others” when identifying 
POC. Students perceived their performance to be worse than “others” when identifying SOI and nurses 
perceived it to be worse than “others” when identifying POC. Nurses and physicians perceived more 
frustration thant did students and “others” when identifying SOI and more than others when identifying 
POC. Lastly, there were no significant differences between nurses and physicians for either task (figures 
3 and 4). 

It should be noted that the three largest groups, physicians (n=41), “other” providers (n=37), 
and nurses (n=25) had an somewhat unequal distribution of experience levels within their respective 
professional groups. The physician group included a large proportion (19 surveys , 46%) with <5 years of 
experience. The “others” group was largely composed of surveys of individuals with 5-10 years of 
experience (22 surveys, 59%). The nurses were similar to the physicians, in that a large proportion of 
those surveyed had <5 years of experience (14 surveys, 56%) (table 2). 

Significant differences were also discovered when study participants were compared based 
upon their years of experience since graduation from licensing school (or year in school for students) (P 
< 0.05 for all comparisons, figures 5-6). Participants with 5-10 years of experience reported the least 
abeut amount of total cognitive work for both tasks compared to clinicians with <5 or >10 years of 
experience. Clinicians with > 10 years of perceived more total cognitive work for both tasks compared 
clinicians with 5-10 years of experience, but less than clinicians with < 5 years of experience. Finally, 
clinicians with < 5 years of experience perceived the most total cognitive work, which was significantly 
more than clinicians with > 4 years of experience. 

When examining subscales that contribute to total cognitive work, the following observations 
were made: Clinicians with sere < 5 years of experience perceived more metal demand than those with 


>4 years of experience when identifying SOI and more than clinicians with 5-10 years of experience 
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when identifying POC. Clinicians with < 5 years of experience perceived more temporal demand and felt 
their performance was worse for both tasks when compared to clinicians with 5-10 years of experience. 
Both tasks were perceived as requiring more effort for clinicians with < 5 years of experience compared 
to those with > 4 years of experience. Clinicians with 5-10 years of experience perceived significantly 
less frustration while identifying SOI than did those with < 5 and those with > 10 years of experience, but 
only less than those with > 10 years of experience when identifying POC. Finally, there was no apparent 
impact of experience on perceived physical demand. The largest differences in workload perception 
were consistently between those with < 5 years and those with 5-10 years of experience for all domains 
except frustration (see figures 5 and 6). 

There were no significant differences in perceived total workload when comparing study sites or 
hours of direct patient care with respect to identifying either SOl or POC. However, there were 
differences between sites for some subscale domains. Site 3 clinicians perceived significantly more 
temporal demand than site 1 when identifying SOI (median 150 [IQR 90-210] vs. 60 [40-80], p< 0.05). 
Site 1 clinicians perceived significantly worse performance when identifying SOI than did clinicians at site 
3 (median 140 [IQR 90-190] vs. 80 [IQR 40-120], p < 0.05). Clinicians at site 2 perceived significantly less 
frustration than clinicians at site 1 or site 3 for both tasks. Site 2 perceived no frustration when 
identifying SOI or POC, whereas clinicians at site 1 and site 3 perceived frustration as a relatively low 
contributor to cegnitive workload when identifying SOI (site 1 & 2 frustration subscale score 20-30 [IQR 


75% 0-120]) and when identifying POC (site 1 & 2 frustration subscale score 30 [IQR 75% 0-120)]). 


Discussions 
This manuscript is the first to describe the cognitive work performed by clinicians during MDR in 
the Burn ICU. The NASA-TLX effectively revealed workload perception differences and similarities in 


cognitive work associated with completing two critical tasks performed during MDR: identifying a 
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patient’s condition (severity of illness, SOI) and prioritizing associated treatments (priority of care, POC). 
Significant findings include: 

1. Mental demand, temporal demand, performance, and effort were the primary determinants 
for the cognitive work performed for the identified tasks on MDR with mental demand 
being greatest; 

2. students, nurses, and physicians all had higher perceived total workload for both SOI and 
POC than “others”; 

3. students perceived the most effort on rounds and had the most mental demand when 
identifying POC and significantly more than “others” when identifying SOI; 

4. students, nurses, and physicians experienced significantly more temporal demand when 
identifying POC than de did “other” healthcare providers while only nurses and physicians 
perceived this significantly more than others for identifying SOI; 

5. clinicians with the least experience Rave had higher perceived workload when identifying 
SOI and POC as compared to those with more experience; 

6. and some individuals perceived more frustration and physical demand than most others 


during MDR. 


Participation in MDR is was associated with a moderate cognitive workload for the nurses, 
physicians, students, and other healthcare professionals in attendance when completing two key tasks. 
Quantification of this workload with the NASA-TLX revealed unequal distribution of workload across the 
subscales of the task load index. Greater contributors to total load were mental demand, temporal 
demand, performance, and effort, with mental demand consistently the greatest for both tasks and 
compared to other subscales. Less substantial contributors were frustration, followed by physical 
demand. MDR is largely a thought exercise and so it shouted is not Se surprising that participants 


reported relatively low physical demand. When taken as a whole, the MDR participants reported a low 
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cognitive workload associated with frustration, particularly at site 2. This low observed frustration level 
may be a reflection of how well the MDR participants are acclimated to the MDR process, experiencing 
relatively low levels of stress, annoyance, and irritation when participating in this well-practiced event or 
that site 2 clinicians work particularly well together, or have some other organizational culture/aspect 
(e.g. a lower census) that minimizes frustration. Also interesting was that the frustration and physical 
demand subscales demonstrated a significant right skew effect, driven by a large number of participants 
reporting little or no load associated with these 2 subscales. This was appreciated at site 2 also. This 
suggests that certain individuals may experience MDR differently than most others. In particular, some 
individuals perceive remarkably more frustration (figures 1-2). 

This study was designed to be descriptive of cognitive workload associated with MDR. We did 
not seek to find significant amerng between group differences and yet such differences were found. 
Why do these differences exist and what impact do they have on patient care? We suspect that 
clinicians undergo a significant paradigm shift in their approach to medical decision making during the 
transition from novice to expert. A general stepwise paradigm of skill acquisition has been described 
previously, and applied to the healthcare setting in prior works.1*7© Ataterstudy One study identified 
significant macro cognitive differences in the approach of a novice physician in the emergency 
department as compared to an expert. Junior physicians had difficulty integrating individual aspects of a 
patient presentation into a cogent picture. The same study showed that less experienced physicians had 
an overreliance on laboratory data and had difficulty integrating data that was inconsistent with their 
current diagnosis.*’ Furthermore, differences in professional background, especially those associated 
with increased specialization with career progression, promote differences in knowledge acquisition and 
information use that simplifies mental modeling, role based planning, and ultimately decreases cognitive 
work. These largely isolated professional development pathways may help explain how different 


healthcare provider types can have significantly different perceived cognitive workloads while 
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performing the same task under the same conditions. This was a phenomenon we observed when 
comparing nurses and physician workload to other, more specialized providers (e.g. respiratory 
therapists, rehabilitation specialist, wound care specialists, pharmacists, and dieticians). Interestingly, 
this compartmentalization, while helpful in easing cognitive workload may actually be 
counterproductive with regards to interprofessional communication and goal sharing on MDR.*® 

We identified that clinicians with <5 years of experience had an increased total cognitive 
workload as compared to more senior clinicians in both the 5-10 year and >10 year groups for both 
tasks. This difference was driven primarily by the effort and mental demand subscales. Our data affirm 
that the difficulties experienced by junior ED physicians extend to the ICU, where patients have complex 
presentations, often with significant pathology in multiple organ systems. Additionally, the ICU is data 
dense: clinicians must find, interpret, and include hundreds of data elements, some of which may be 
contradictory to each other, fer from disparate sources such as vital signs monitors, laboratory 
reports, imaging studies, devices, other clinicians, protocols, knowledge bases.'*”° Processing all of this 
data into an accurate assessment of SOI and determination of POC is a highly demanding task for the 
expert, let alone the novice. Limiting or simplifying these data inputs may be a way to decrease 
perceived cognitive workload for novice providers. Video projectors have been used successfully to 
make patient data available to MDR teams.”? Such interventions may have a role in easing the burden of 
gleaning and recalling relevant data and allowing the novice to devote additional mental work to 
processing this data into important patient assessments. 

Medical students are a group with arguably the least experience on the MDR team. They are 
operating in what is essentially a novel environment while involving themselves in the care of patients 
with complex pathophysiology. Students had a significantly higher level of workload as measured by 


the effort subscale when identifying SOI as compared to physicians with more experience. This 
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difference is not surprising as we might expect medical students to expend more cognitive effort in 
order to meaningfully participate in MDR. 

Overall perceived total cognitive workload associated with identifying SOI and POC was similar 
when students, nurses, and physicians were compared. This total load reflected a weighted sum of all 6 
NASA-TLX sub scores. These groups reported significantly higher workload for both tasks than the 
“others” group. This difference may be related to the cultural compartmentalization observed in 
individual healthcare professional communities, mentioned above. The difference may also be a 
reflection of differences in the duties and responsibilities commonly assumed by the different clinician 
types. These data should not be taken to mean the “other” providers on the MDR team contribute less 
because of their lower perceived workload; to the contrary, efforts should be made to achieve optimally 
low workloads for all MDR team members. 

Increased temporal demand, particularly for nurses and physicians, may stem from a perceived 
need to see other patients, adhere to schedules, and perform other tasks both patient care related (e.g. 
family meetings, procedures, documentation) and administrative, educational, or research related (e.g. 
staff meetings, presentations, protocol development). Temporal demand was a particularly high 
contributor to total cognitive work at site 3, a busy academic and research oriented facility. Perhaps 
what goes on outside of MDR and/or away from the ICU drives this perceived increase in temporal 
demand. Limiting responsibilities outside of the ICU might improve perceived workload. 

Interestingly, clinicians at site 1 had the lowest perceived temporal demand, atsite+ but this 
was not associated with improved perception of performance with respect to identifying SOI. The 
importance of this finding is not clear as one might expect that less time pressure might improve 
perceived importance performance. 

Another interesting trend was observed when examining perceived workload by years of 


experience. Those in the 5-10 year groups generally reported lower perceived workload than >10 year 
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groups. This phenomenon was evident in the mental demand, temporal demand, performance, effort, 
and frustration subscales observed for SOI, as well as the mental demand, temporal demand, and effort, 
and frustration subscales for POC. Examination of the composition of the experience groups by 
healthcare professional type revealed an uneven distribution of provider types across the experience 
groups. The 5-10 year group was composed of a disproportionately large number of “other” providers, 
as compared to the <5 and >10 years groups. Given that the “other” providers generally have a lower 
perceived workload as compared to the student, nurse, and physician groups, this differential helps to 
explain the observed trend. Certainly there may also be some inherent workload decrease in the 5-10 
year group. This may represent a sort of cognitive apex effect, where professional development 
towards expertise is significant, frequency of task performance is optimal, and the clinicians has the 
advantage of relative youth compared to more senior counterparts as Tsang has demonstrated.” 

Other authors have shown that a higher cognitive workload, as measured with the NASA-TLX, is 
associated with increased error rates in medical practice.1°1! This study identified relative inexperience 
as a factor associated with higher workload. We also identified medical students, nurses, and physicians 
as groups with relatively high associated cognitive workload. When taken together, this suggests that 
novice nurses and doctors may be at particularly high risk for committing mental errors associated with 
determination of SOI and POC. Incidentally these groups are responsible for providing much of the 
direct patient care within the ICU. Patient outcomes may be improved when providers are cognizant of 
an accurate assessment of the patients’ illness severity.’? A tool which provides these novice providers 
with an explicit assessment of patient SOI and by extension, the POC for management has the potential 
to reduce mental errors and improve outcomes in the ICU.” 

These data are particularly valuable because they were collected at the time of the activity and, 
therefore, are less likely to be distorted by recall errors. Inter-center variability was examined and no 


significant differences were detected among study sites. This is consistent with the idea that the work 
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of MDR is not significantly affected by site specific factors. This speaks well to the external validity of 
the data generated. 

This study had several important limitations. Data collection methods were not identical at each 
study center due to center-specific workflow differences. This may have introduced some confounding 
variability into the data set. We were not able to detect any significant inter-center workload 
differences; however, this study was not designed, and therefore not powered, to support such 
conclusions. The study was designed primarily to be descriptive of workload. Significant differences 
were discovered, as detailed above, but the failure to detect a significant difference cannot be taken to 
mean that such a difference does not exist. Another important limitation is that surveys were 
conducted on multiple occasions at each center over the course of a relatively short period of time.; 
and, As a consequence, some providers were surveyed more than once. This resulted in an increased ia 
number of data points entered into the analysis relative to the number of discrete survey takers. This 
may have resulted in an underestimation of variability within the study model. 

In conclusion, this study provides insight into the workings of a complex MDR process in the ICU. 
We were able to identify groups within the MDR that experience higher workload as compared to others 
when completing two essential, yet often unspoken and unsupported, tasks. Furthermore, by 
describing the groups which experienced the highest perceived workload during MDR, we have 
identified the groups which stand to benefit the most from interventions targeted at decreasing the 
FAental cognitive work associated with MDR. The study also serves as an affirmation that the NASA-TLX 
is an efficient tool which can be utilized ia-during a time fecused pressured environment event like 
MDR. These findings support future works aimed at reducing perceived workload, as quantified with 


the NASA-TLX, during MDR in the Burn ICU. 
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Figure 1. NASA-TLX subscale scores and total load for all survey takers for completion of task 1 (“Identify 
if the patient is better, same, or worse than yesterday,” i.e. determine the severity of illness, SOI), 
represented as median (line within box), inner quartile range (box), and range (capped lines). Weighted 
subscale values range from 0-500 (subscale value 0-100 x subscale weight). The total load scales range 


from 0-100 and are equal to a sum of the weighted subscale values divided by 15. 
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Figure 2. NASA-TLX subscale scores and total load for all survey takers for completion of task 2 (“Identify 
the priorities of care today” or POC), represented as median (line within box), inner quartile range (box), 
and range (capped lines).. Weighted subscale values range from 0-500 (subscale value 0-100 x subscale 

weight?). The total load scales range from 0-100 and are equal to a sum of the weighted subscale values 


divided by 15. 
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Figure 3. Median values for the NASA-TLX subscales and overall workload for completing task 1 
(“Identify if the patient is better, same, or worse than yesterday,” i.e. determine the severity of illness, 
SOl), as compared among clinician groups. Weighted subscale values range from 0-500 (subscale value 
0-100 x subscale weight*). The total load scales range from 0-100 and are equal to a sum of the 
weighted subscale values divided by 15. 

* P<0.05 by Steel-Dwass Method 

+P <0.05 by Wilcoxon Method 


@P<0.05 by both methods 
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Figure 4. Median values for the NASA-TLX subscales and overall workload for completing task 2 
(“Identify the priorities of care today” or POC), as compared among clinician groups. Weighted subscale 
values range from 0-500 (subscale value 0-100 x subscale wight*). The total load scales range from 0-100 
and are equal to a sum of a the weighted subscale values divided by 15. 

* P<0.05 by Steel-Dwass Method 

+P <0.05 by Wilcoxon Method 


@P<0.05 by both methods 
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Figure 5. Median values for the NASA-TLX subscales and overall workload for completing task 1 
(“Identify if the patient is better, same, or worse than yesterday,” i.e. determine the severity of illness, 
SOI), as compared among subgroups defined by years of experience. Weighted subscale values range 
from 0-500 (subscale value 0-100 x subscale wight°). The total load scales range from 0-100 and are 
equal to a sum of the weighted subscale values divided by 15. 

* P<0.05 by Steel-Dwass Method 

+P <0.05 by Wilcoxon Method 


@P<0.05 by both methods 
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Figure 6. Median values for the NASA-TLX subscales and overall workload for completing task 2 
(“Identify the priorities of care today” or POC), as compared among subgroups defined by years of 
experience. Weighted subscale values range from 0-500 (subscale value 0-100 x subscale wight?). The 
total load scales range from 0-100 and are equal to a sum of the weighted subscale values divided by 15. 
* P<0.05 by Steel-Dwass Method 

+P <0.05 by Wilcoxon Method 


@P<0.05 by both methods 
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Tables 


Table 1. Demographic data for our convenience sample of clinicians participating in multidisciplinary 
rounds and willing to participate in this research describing the size, constitution, and years of 
experience since graduation from licensing school (or year in school for students) of the four subgroups 
of survey takers. CN — charge nurse, CNS — clinical nurse specialist, HN — head nurse, OT — occupational 
therapist, RT — respiratory therapist. 


Average 
Group n Experience <5 yrs 5-10 yrs >10 yrs 
(range) 
Physician 41 19 11 11 
Medical Intensivist 3 16.3 (10-27) 0 1 2 
Burn Surgeon 11 11.8 (0-16) 222 1 8 
Resident 18 2.1 (0-13) 17 0 1 
Fellow 9 5.9 (5-6) 0 9 0 
Nurse 25 14 5 6 
CN/CNS/HN 7 4.3 (0-12) 4 2 1 
Nurse 18 8.9 (0-35) 10 3 5 
Medical Student 13 2.5 (0-4) 13 0 0 
Other Provider 37 4 22 11 
Dietician 18 7.4 (5-10) 0 18 0 
OT 1 1 1 0 0 
Pharmacist 7 12.1 (2-24) 1 3 3 
Psychiatry Support 1 13 0 0 1 
RT| 10 12.6 (4-25) 2 1 7 
DEE es 
Total 116 50 38 28 
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Table 2. NASA-TLX subscale scores for all survey takers for completion of task 1 (“Identify if the patient is 
better, same, or worse than yesterday,” i.e. determine the severity of illness, SOl) and task 2 (“Identify 
the priorities of care today” or POC), ranked by median subscale score. This constitutes a rank-order list 
describing subscale contributors to overall workload, denoted as “Total” below. 


Task 1: Severity of Illness Task 2: Priority of Care 
Rank Order Average Score Average Score 
Subscale (1aR) Subscale (1aR) 
1 Mental 150 (90-210) Mental 120 (80-160) 
2 Effort 120 (80-160) Temporal 100 (60-140) 
3 Performance 100 (60-140) Performance 90 (50-130) 
4 Temporal 90 (50-130) Effort 90 (50-130) 
5 Frustration 20 (20-20) Frustration 20 (20-20) 
6 Physical 0 (0-0) Physical 0 (0-0) 
Total 40 (13-67) 43 (18-68) 
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Title: Comparing the workload perceptions of identifying patient condition and priorities of care among 
burn providers in three Burn ICUs. 


Abstract 


Introduction: 

Multidisciplinary rounds (MDR) in the Burn Intensive Care Unit serve as an efficient means for 
clinicians to assess patient status and establish patient care priorities. Both tasks require significant 
cognitive work, the magnitude of which is relevant because increased cognitive work of task completion 
has been associated with increased error rates. We sought to quantify this workload during MDR using 
the National Aeronautics and Space Administration Task Load Index (NASA-TLX). 


Methods: 

Research staff at 3 academic regional referral burn centers administered the NASA-TLX to 
clinicians during MDR. Clinicians assessed their workload associated with 1) “Identify[ing] if the patient 
is better, same, or worse than yesterday” and 2) “Identify[ing] the most important objectives of care for 
the patient today.” Data were collected on clinician type, years of experience, and hours of direct 
patient care. 


Results: 

Surveys were administered to 116 total clinicians, 41 physicians, 25 nurses, 13 medical students 
and 37 clinicians in other roles. Clinicians with less experience reported more cognitive work when 
completing both tasks (p<.005). Clinicians in the “others” group (respiratory therapists, dieticians, 
pharmacists, etc.) reported less cognitive work than all other groups for both tasks (p<0.05). 


Conclusions: 

The NASA-TLX was an effective tool for collecting perceptions of cognitive workload associated 
with MDR. Perceived cognitive work varied by clinician type and experience level when completing 2 
key tasks. Less experience was associated with increased perceived work, potentially increasing metal 
error rates and increasing risk to patients. Creating tools or work processes to reduce cognitive work 
may improve clinician performance. 
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Task Performance and Analysis 


Introduction 

The burn intensive care unit (ICU) presents a challenging work environment to the healthcare 
team. Effective care requires the coordinated effort of healthcare professionals from different 
backgrounds, each member contributing unique perspective toward a common goal. These teams are a 
necessity given the complexity of managing the medical, administrative, and social aspects of patient 
care. Multidisciplinary rounds (MDR) is an event that facilitates communication of relevant information 
among team members and is associated with better outcomes in the ICU.**? 

While MDR represent a powerful tool and a logical means for efficient dissemination of 
information, there is variability in the quality and effectiveness of such rounds. MDR must encompass 
key aspects of care, to include problems, plans, and goals. The multidisciplinary team must be 
effectively managed to ensure that all important aspects of patient care are addressed. Caution must 
also be taken to ensure that information is discussed clearly and in such a way that it is accessible to all 
members of the team who need it; thus, helping to avoid the need for inefficient clarifications with 
individual team members after MDR have ended.* Input from all team members must be evaluated and 
integrated by the team leader, typically a physician, in such a way as to create a cohesive, prioritized 
care plan. 2 

A series of decisions are made during MDR, some critical, some routine. Likewise the cognitive 
work that goes into making these decisions is variable. In the same way that physical work is defined in 
terms of distance and force, cognitive work can be imagined as a function of a task and the perceived 
effort required to complete it. Different people have different perceived workloads when completing 
the same task according to their familiarity with the task and their overall experience with the task or 
similar tasks.° Calculating workload by this definition requires quantification of perceived mental 
“force.” Hart and Staveland developed the National Aeronautics and Space Administration Task Load 


Index (NASA-TLX), a survey composed of six subscales, designed to assess perceived workload of NASA 


pilots. These subscales include mental demand, physical demand, temporal demand, frustration, effort, 
and performance as defined in the NASA-TLX Manuscript.? The NASA-TLX has been used broadly in 
aviation, the automotive industry, and more recently in medicine.°™ 

Lower perceived workload, as measured by the NASA-TLX, has been linked to better 
performance in medicine.*°*? Proper identification of a patient’s illness severity may also be associated 
with improved clinician performance. Starmer and colleagues demonstrated a significant reduction in 
preventable adverse events after implementation of a tool that increased communication of patient 
illness severity during change-of-shift handoffs.” 

Multidisciplinary rounds present a cognitive challenge: to integrate data, make diagnoses, 
prioritize care tasks, provide education, and to form shared mental models.** The magnitude of this 
challenge, however, has not been well defined. Also unclear are the differences in cognitive workload, if 
any, experienced by the different types of clinicians who participate in MDR. The current study sought 
to define the perceived workload associated with the completion of two important tasks during MDR: 
generating a personal assessment of overall patient condition and identifying the priorities for the day’s 


care plan. 


Methods 

We conducted this institutional review board approved survey study in three American Burn 
Association verified regional referral Burn ICUs. The NASA-TLX surveys were administered by research 
staff to clinicians at each site who participated in MDR during daily clinical practice according to the 
process outlined below. 

Admission rates to these Burn ICUs varies from 270 to 300 patients per year with an average 
daily census between 2 (site 2) and 5 (site 1 and 3). At each site, MDR are led by an attending physician 
who was either a burn surgeon credentialed in critical care (sites 1, 2, and 3), or a medical intensivist 
with extensive burn experience (site 1). Nurse to patient ratios vary among sites from 1-to-1.5 nurses 
per patient at site 1, to 1 nurse per patient at sites 2 and 3. Attendance at MDR varies, but typically 
consists of the bedside nurse, rehabilitation specialists, registered dieticians, clinical pharmacists, 


respiratory therapists, burn fellows, residents, and students. 


Multi-Disciplinary Rounds Conduct 


MDR typically consisted of a resident presenting the patient by systems followed by other team 
members providing additional pertinent details and recommendations as they felt appropriate. The 
attending physician would direct the information flow and sequence of rounds as he felt necessary and 
would elicit from the team and/or state a care plan for the patient. Additionally, site 1 used a daily 
communication tool completed by the unit’s “charge nurse” (e.g. nursing shift leader). This 
communication tool consists of a checklist that confirms use/absence of certain quality metrics (i.e. 
deep venous thrombosis prophylaxis, gastric ulcer prophylaxis, head-of-bed elevation, etc.) and a list of 
daily tasks that the charge nurse identified during rounds. At site 1, the charge nurse reviews the 
checklist and reads the identified tasks as the last activity of a patient’s rounds prior to the MDR team 


moving on to the next patient. 


Survey Administration: 


Research staff administered the NASA-TLX as either a paper (sites 1 & 3) or electronic (site 2) 
survey to a convenience sample of clinicians present on MDR for at least five discrete rounds events. A 
“discrete rounds event” was MDR rounds for a single patient. Thus, the NASA-TLX could be 
administered once per day for five days or five times in a single day for five different patients. Surveys 
were administered immediately after MDR was complete for a single ICU patient. Each site adjusted the 
survey collection period to meet the needs of their site and according to patient volume. Surveys were 
administered during different points in the MDR to account for physical and mental fatigue that may 
impact workload perception. For example, surveys were administered early in rounds (after the first 
patient), middle (after the middle patient) or late in rounds (after the last patient). 

Prior to administration of the NASA-TLX survey, research staff reviewed a consent document 
with potential clinician subjects who participated in MDR. Clinicians were not required to participate, 
but their participation implied consent. Subjects were allowed to quit the study at any time by not 
completing the survey. Incomplete surveys were not included in the data analysis. Participation was 
anonymous and no personally identifying information or master list of participants was collected. We 
collected participant demographics including clinician type, years of experience, and time spent in direct 
care of the patient. 

After the consent was reviewed and a copy provided to subjects, the research staff read 
directions aloud and then provided the NASA-TLX survey to participants. Time was provided for 
questions and clarification by the research staff. Clinicians assessed their workload associated with two 
tasks identified by the following questions: 1) "Identify if the patient is better, same or worse than 


yesterday" and 2) "Identify the most important objectives of care for the patient today." 


Statistical Analysis 


For the purpose of this study, we analyzed results according to the following groups: “physician” 
represents all attending physicians (burn surgeons or medical intensivists) who led or participated in 
MDR, as well as all physicians in training including those physicians who were part of a certified 
residency training program or fellowship; “nurse” represented all nurse types including licensed 
vocational nurses, registered nurses, and clinical nurse specialists; “student” represented medical 
students; and “other” represented clinicians not in any other category including respiratory therapists, 
dieticians, occupational or physical therapists, pharmacists, and psychiatry support personnel. 

NASA-TLX Scores were calculated as described by Hart?: weighted cognitive load was calculated 
by first determining individual subscale ratings for mental demand, physical, temporal, performance, 
effort, and frustration; reported on a scale of 0-100 by asking subjects to place a mark ona line divided 
into 50 equal parts. A researcher then converted this analog representation into a value from 0-100. 
Individual subscales ratings were given a weighting factor which represented the perceived importance 
of a given subscale relative to the other subscales. This weight equaled the number of times a subject 
selected the subscale over another subscale while completing the “sources of workload” portion of the 
NASA-TLX survey. During this portion of the survey, subjects were asked to determine which subscales 
were the more important contributors to workload according to a series of 15 pair-wise comparisons. 
Thus, a weight could range from 0-5 (0 meaning that a subject never chose the subscale compared to 
other subscales and 5 meaning the subject always chose a subscale when comparing it to other 
subscales). Individual raw subscale data were multiplied by this weighting factor and were then 
summed. This sum was then divided by 15 to yield the weighted (total) workload. 

The NASA-TLX survey scores were summarized using medians and interquartile ranges for each 
of the demographic groups. Due to the small sample size and lack of normality, the scores were 
analyzed using the nonparametric Wilcoxon's Test with the Steel-Dwass correction for multiple test 


correction.” Significance was established when the p-value was less than 0.05. All analysis was 


performed using Statistical Analysis System (SAS) v9.2, SAS Institute Inc., Cary, USA or JMP v10.0, SAS 


Institute Inc., Cary, USA. 


Results 


Surveys were administered to a total of 119 clinicians across all sites; however three surveys 
were incomplete and were excluded from the analysis for a final n = 116. The median weighted 
cognitive load for task 1, identifying if a patient was better, same, or worse than the previous day (i.e. 
identifying the patient’s “severity of illness” or SOI), was 40 (IQR 13-67). The median weighted cognitive 
load rating for task 2, identifying the most important objectives of care for the patient today (i.e. 


“ 


identifying the patient’s “priorities of care” or POC) was 43 (IQR 18-68). Mental demand, temporal 
demand, performance, and effort all contributed more to the overall cognitive load than did physical 
demand or frustration subscales (table 1, figures 1-2). Perceived workload varied significantly according 
to clinician experience and professional background (figures 3-6), but not according to clinician location 
or time spent with the patient (data not shown). Interestingly, the frustration and physical demand 
subscales were particularly non-normal in their distribution across our sample. Forty percent of 
respondents reported no frustration and 63% of respondents reported no physical demand for 
identifying SOl. Numbers were similar for respondents’ perception of frustration and physical demand 
for identifying POCs: 38% and 62% reported zero frustration or physical demand respectively. 
Comparing perceived cognitive workload between clinician types revealed several significant 
differences (p < 0.05 for all comparisons, figures 3-4). Students, nurses, and physicians experienced a 
higher total cognitive workload than did “others” when identifying both SOI and POC. Students 
experienced more mental demand than “others” when identifying SOI and more than nurses and 


“others” when identifying POC. Nurses and physicians experienced more temporal demand than the 


“others” group when identifying SOI, while students, nurses, and physicians experienced more temporal 


demand than “others” when identifying POC. Students also reported increased effort associated with 
identifying SOI as compared to all other groups, and more than physicians and “others” when identifying 
POC. Students perceived their performance to be worse than “others” when identifying SOI and nurses 
perceived it to be worse than “others” when identifying POC. Nurses and physicians perceived more 
frustration than students and “others” when identifying SOI and more than others when identifying 
POC. Lastly, there were no significant differences between nurses and physicians for either task (figures 
3 and 4). 

It should be noted that the three largest groups, physicians (n=41), “other” providers (n=37), 
and nurses (n=25) had an unequal distribution of experience levels within their respective professional 
groups. The physician group included a large proportion (19 surveys , 46%) with <5 years of experience. 
The “others” group was largely composed of surveys of individuals with 5-10 years of experience (22 
surveys, 59%). The nurses were similar to the physicians, in that a large proportion of those surveyed 
had <5 years of experience (14 surveys, 56%) (table 2). 

Significant differences were also discovered when study participants were compared based 
upon their years of experience since graduation from licensing school (or year in school for students) (P 
< 0.05 for all comparisons, figures 5-6). Participants with 5-10 years of experience reported the least 
amount of total cognitive work for both tasks compared to clinicians with <5 or >10 years of experience. 
Clinicians with > 10 years of perceived more total cognitive work for both tasks compared clinicians with 
5-10 years of experience, but less than clinicians with < 5 years of experience. Finally, clinicians with <5 
years of experience perceived the most total cognitive work, which was significantly more than clinicians 
with > 4 years of experience. 

When examining subscales that contribute to total cognitive work, the following observations 
were made: Clinicians with < 5 years of experience perceived more metal demand than those with >4 


years of experience when identifying SOI and more than clinicians with 5-10 years of experience when 
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identifying POC. Clinicians with <5 years of experience perceived more temporal demand and felt their 
performance was worse for both tasks when compared to clinicians with 5-10 years of experience. Both 
tasks were perceived as requiring more effort for clinicians with < 5 years of experience compared to 
those with > 4 years of experience. Clinicians with 5-10 years of experience perceived significantly less 
frustration while identifying SOI than did those with <5 and those with > 10 years of experience, but 
only less than those with > 10 years of experience when identifying POC. Finally, there was no apparent 
impact of experience on perceived physical demand. The largest differences in workload perception 
were consistently between those with < 5 years and those with 5-10 years of experience for all domains 
except frustration (see figures 5 and 6). 

There were no significant differences in perceived total workload when comparing study sites or 
hours of direct patient care with respect to identifying either SOl or POC. However, there were 
differences between sites for some subscale domains. Site 3 clinicians perceived significantly more 
temporal demand than site 1 when identifying SOI (median 150 [IQR 90-210] vs. 60 [40-80], p< 0.05). 
Site 1 clinicians perceived significantly worse performance when identifying SOI than did clinicians at site 
3 (median 140 [IQR 90-190] vs. 80 [IQR 40-120], p < 0.05). Clinicians at site 2 perceived significantly less 
frustration than clinicians at site 1 or site 3 for both tasks. Site 2 perceived no frustration when 
identifying SOI or POC, whereas clinicians at site 1 and site 3 perceived frustration as a relatively low 
contributor to workload when identifying SOI (site 1 & 2 frustration subscale score 20-30 [IQR 75% O- 


120]) and when identifying POC (site 1 & 2 frustration subscale score 30 [IQR 75% 0-120)). 


Discussions 
This manuscript is the first to describe the cognitive work performed by clinicians during MDR in 
the Burn ICU. The NASA-TLX effectively revealed workload perception differences and similarities in 


cognitive work associated with completing two critical tasks performed during MDR: identifying a 
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patient’s condition (severity of illness, SOI) and prioritizing associated treatments (priority of care, POC). 
Significant findings include: 

1. Mental demand, temporal demand, performance, and effort were the primary determinants 
for the cognitive work performed for the identified tasks on MDR with mental demand 
being greatest; 

2. students, nurses, and physicians all had higher perceived total workload for both SOI and 
POC than “others”; 

3. students perceived the most effort on rounds and had the most mental demand when 
identifying POC and significantly more than “others” when identifying SOI; 

4. students, nurses, and physicians experienced significantly more temporal demand when 
identifying POC than did “other” healthcare providers while only nurses and physicians 
perceived this significantly more than others for identifying SOI; 

5. clinicians with the least experience had higher perceived workload when identifying SOI and 
POC as compared to those with more experience; 

6. and some individuals perceived more frustration and physical demand than most others 


during MDR. 


Participation in MDR is was associated with a moderate cognitive workload for nurses, 
physicians, students, and other healthcare professionals in attendance when completing two key tasks. 
Quantification of this workload with the NASA-TLX revealed unequal distribution of workload across the 
subscales of the task load index. Greater contributors to total load were mental demand, temporal 
demand, performance, and effort, with mental demand consistently the greatest for both tasks and 
compared to other subscales. Less substantial contributors were frustration, followed by physical 
demand. MDR is largely a thought exercise and so it is not surprising that participants reported 


relatively low physical demand. When taken as a whole, the MDR participants reported a low cognitive 
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workload associated with frustration, particularly at site 2. This low observed frustration level may be a 
reflection of how well the MDR participants are acclimated to the MDR process, experiencing relatively 
low levels of stress, annoyance, and irritation when participating in this well-practiced event or that site 
2 clinicians work particularly well together, or have some other organizational culture/aspect (e.g. a 
lower census) that minimizes frustration. Also interesting was that the frustration and physical demand 
subscales demonstrated a significant right skew effect, driven by a large number of participants 
reporting little or no load associated with these 2 subscales. This was appreciated at site 2 also. This 
suggests that certain individuals may experience MDR differently than most others. In particular, some 
individuals perceive remarkably more frustration (figures 1-2). 

This study was designed to be descriptive of cognitive workload associated with MDR. We did 
not seek to find significant between group differences and yet such differences were found. Why do 
these differences exist and what impact do they have on patient care? We suspect that clinicians 
undergo a significant paradigm shift in their approach to medical decision making during the transition 
from novice to expert. A general stepwise paradigm of skill acquisition has been described previously, 
and applied to the healthcare setting in prior works.***> One study identified significant macro cognitive 
differences in the approach of a novice physician in the emergency department as compared to an 
expert. Junior physicians had difficulty integrating individual aspects of a patient presentation into a 
cogent picture. The same study showed that less experienced physicians had an overreliance on 
laboratory data and had difficulty integrating data that was inconsistent with their current diagnosis.*” 
Furthermore, differences in professional background, especially those associated with increased 
specialization with career progression, promote differences in knowledge acquisition and information 
use that simplifies mental modeling, role based planning, and ultimately decreases cognitive work. 
These largely isolated professional development pathways may help explain how different healthcare 


provider types can have significantly different perceived cognitive workloads while performing the same 
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task under the same conditions. This was a phenomenon we observed when comparing nurses and 
physician workload to other, more specialized providers (e.g. respiratory therapists, rehabilitation 
specialist, wound care specialists, pharmacists, and dieticians). Interestingly, this compartmentalization, 
while helpful in easing cognitive workload may actually be counterproductive with regards to 
interprofessional communication and goal sharing on MDR.*® 

We identified that clinicians with <5 years of experience had an increased total cognitive 
workload as compared to more senior clinicians in both the 5-10 year and >10 year groups for both 
tasks. This difference was driven primarily by the effort and mental demand subscales. Our data affirm 
that the difficulties experienced by junior ED physicians extend to the ICU, where patients have complex 
presentations, often with significant pathology in multiple organ systems. Additionally, the ICU is data 
dense: clinicians must find, interpret, and include hundreds of data elements, some of which may be 
contradictory to each other, from disparate sources such as vital signs monitors, laboratory reports, 
imaging studies, devices, other clinicians, protocols, knowledge bases.’?”° Processing all of this data into 
an accurate assessment of SOI and determination of POC is a highly demanding task for the expert, let 
alone the novice. Limiting or simplifying these data inputs may be a way to decrease perceived 
cognitive workload for novice providers. Video projectors have been used successfully to make patient 
data available to MDR teams.” Such interventions may have a role in easing the burden of gleaning and 
recalling relevant data and allowing the novice to devote additional mental work to processing this data 
into important patient assessments. 

Medical students are a group with arguably the least experience on the MDR team. They are 
operating in what is essentially a novel environment while involving themselves in the care of patients 
with complex pathophysiology. Students had a significantly higher level of workload as measured by 


the effort subscale when identifying SOI as compared to physicians with more experience. This 
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difference is not surprising as we might expect medical students to expend more cognitive effort in 
order to meaningfully participate in MDR. 

Overall perceived total cognitive workload associated with identifying SOI and POC was similar 
when students, nurses, and physicians were compared. This total load reflected a weighted sum of all 6 
NASA-TLX sub scores. These groups reported significantly higher workload for both tasks than the 
“others” group. This difference may be related to the cultural compartmentalization observed in 
individual healthcare professional communities, mentioned above. The difference may also be a 
reflection of differences in the duties and responsibilities commonly assumed by the different clinician 
types. These data should not be taken to mean the “other” providers on the MDR team contribute less 
because of their lower perceived workload; to the contrary, efforts should be made to achieve optimally 
low workloads for all MDR team members. 

Increased temporal demand, particularly for nurses and physicians, may stem from a perceived 
need to see other patients, adhere to schedules, and perform other tasks both patient care related (e.g. 
family meetings, procedures, documentation) and administrative, educational, or research related (e.g. 
staff meetings, presentations, protocol development). Temporal demand was a particularly high 
contributor to total cognitive work at site 3, a busy academic and research oriented facility. Perhaps 
what goes on outside of MDR and/or away from the ICU drives this perceived increase in temporal 
demand. Limiting responsibilities outside of the ICU might improve perceived workload. 

Interestingly, clinicians at site 1 had the lowest perceived temporal demand, but this was not 
associated with improved perception of performance with respect to identifying SOI. The importance of 
this finding is not clear as one might expect that less time pressure might improve perceived 
performance. 

Another interesting trend was observed when examining perceived workload by years of 


experience. Those in the 5-10 year groups generally reported lower perceived workload than >10 year 
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groups. This phenomenon was evident in the mental demand, temporal demand, performance, effort, 
and frustration subscales observed for SOI, as well as the mental demand, temporal demand, and effort, 
and frustration subscales for POC. Examination of the composition of the experience groups by 
healthcare professional type revealed an uneven distribution of provider types across the experience 
groups. The 5-10 year group was composed of a disproportionately large number of “other” providers, 
as compared to the <5 and >10 years groups. Given that the “other” providers generally have a lower 
perceived workload as compared to the student, nurse, and physician groups, this differential helps to 
explain the observed trend. Certainly there may also be some inherent workload decrease in the 5-10 
year group. This may represent a sort of cognitive apex effect, where professional development 
towards expertise is significant, frequency of task performance is optimal, and the clinician has the 
advantage of relative youth compared to more senior counterparts as Tsang has demonstrated.” 

Other authors have shown that a higher cognitive workload, as measured with the NASA-TLX, is 
associated with increased error rates in medical practice.1°1! This study identified relative inexperience 
as a factor associated with higher workload. We also identified medical students, nurses, and physicians 
as groups with relatively high associated cognitive workload. When taken together, this suggests that 
novice nurses and doctors may be at particularly high risk for committing mental errors associated with 
determination of SOI and POC. Incidentally these groups are responsible for providing much of the 
direct patient care within the ICU. Patient outcomes may be improved when providers are cognizant of 
an accurate assessment of the patients’ illness severity.’” A tool which provides these novice providers 
with an explicit assessment of patient SOI and by extension, the POC for management has the potential 
to reduce mental errors and improve outcomes in the ICU.” 

These data are particularly valuable because they were collected at the time of the activity and, 
therefore, are less likely to be distorted by recall errors. Inter-center variability was examined and no 


significant differences were detected among study sites. This is consistent with the idea that the work 
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of MDR is not significantly affected by site specific factors. This speaks well to the external validity of 
the data generated. 

This study had several important limitations. Data collection methods were not identical at each 
study center due to center-specific workflow differences. This may have introduced some confounding 
variability into the data set. We were not able to detect any significant inter-center workload 
differences; however, this study was not designed, and therefore not powered, to support such 
conclusions. The study was designed primarily to be descriptive of workload. Significant differences 
were discovered, as detailed above, but the failure to detect a significant difference cannot be taken to 
mean that such a difference does not exist. Another important limitation is that surveys were 
conducted on multiple occasions at each center over the course of a relatively short period of time. Asa 
consequence, some providers were surveyed more than once. This resulted in an increased number of 
data points entered into the analysis relative to the number of discrete survey takers. This may have 
resulted in an underestimation of variability within the study model. 

In conclusion, this study provides insight into the workings of a complex MDR process in the ICU. 
We were able to identify groups within the MDR that experience higher workload as compared to others 
when completing two essential, yet often unspoken and unsupported, tasks. Furthermore, by 
describing the groups which experienced the highest perceived workload during MDR, we have 
identified the groups which stand to benefit the most from interventions targeted at decreasing the 
cognitive work associated with MDR. The study also serves as an affirmation that the NASA-TLX is an 
efficient tool which can be utilized during a time pressured event like MDR. These findings support 
future works aimed at reducing perceived workload, as quantified with the NASA-TLX, during MDR in the 


Burn ICU. 
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Figure 1. NASA-TLX subscale scores and total load for all survey takers for completion of task 1 (“Identify 
if the patient is better, same, or worse than yesterday,” i.e. determine the severity of illness, SOI), 
represented as median (line within box), inner quartile range (box), and range (capped lines). Weighted 
subscale values range from 0-500 (subscale value 0-100 x subscale weight). The total load scales range 


from 0-100 and are equal to a sum of the weighted subscale values divided by 15. 
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Figure 2. NASA-TLX subscale scores and total load for all survey takers for completion of task 2 (“Identify 
the priorities of care today” or POC), represented as median (line within box), inner quartile range (box), 
and range (capped lines).. Weighted subscale values range from 0-500 (subscale value 0-100 x subscale 

weight?). The total load scales range from 0-100 and are equal to a sum of the weighted subscale values 


divided by 15. 
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Figure 3. Median values for the NASA-TLX subscales and overall workload for completing task 1 
(“Identify if the patient is better, same, or worse than yesterday,” i.e. determine the severity of illness, 
SOl), as compared among clinician groups. Weighted subscale values range from 0-500 (subscale value 
0-100 x subscale weight*). The total load scales range from 0-100 and are equal to a sum of the 
weighted subscale values divided by 15. 

* P<0.05 by Steel-Dwass Method 

+P <0.05 by Wilcoxon Method 


@P<0.05 by both methods 
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Figure 4. Median values for the NASA-TLX subscales and overall workload for completing task 2 
(“Identify the priorities of care today” or POC), as compared among clinician groups. Weighted subscale 
values range from 0-500 (subscale value 0-100 x subscale wight*). The total load scales range from 0-100 
and are equal to a sum of a the weighted subscale values divided by 15. 

* P<0.05 by Steel-Dwass Method 

+P <0.05 by Wilcoxon Method 


@P<0.05 by both methods 
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Figure 5. Median values for the NASA-TLX subscales and overall workload for completing task 1 
(“Identify if the patient is better, same, or worse than yesterday,” i.e. determine the severity of illness, 
SOI), as compared among subgroups defined by years of experience. Weighted subscale values range 
from 0-500 (subscale value 0-100 x subscale wight°). The total load scales range from 0-100 and are 
equal to a sum of the weighted subscale values divided by 15. 

* P<0.05 by Steel-Dwass Method 

+P <0.05 by Wilcoxon Method 


@P<0.05 by both methods 
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Figure 6. Median values for the NASA-TLX subscales and overall workload for completing task 2 
(“Identify the priorities of care today” or POC), as compared among subgroups defined by years of 
experience. Weighted subscale values range from 0-500 (subscale value 0-100 x subscale wight?). The 
total load scales range from 0-100 and are equal to a sum of the weighted subscale values divided by 15. 
* P<0.05 by Steel-Dwass Method 

+P <0.05 by Wilcoxon Method 


@P<0.05 by both methods 
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Tables 


Table 1. Demographic data for our convenience sample of clinicians participating in multidisciplinary 
rounds and willing to participate in this research describing the size, constitution, and years of 
experience since graduation from licensing school (or year in school for students) of the four subgroups 
of survey takers. CN — charge nurse, CNS — clinical nurse specialist, HN — head nurse, OT — occupational 
therapist, RT — respiratory therapist. 


Average 
Group n Experience <5 yrs 5-10 yrs >10 yrs 
(range) 
Physician 41 19 11 11 
Medical Intensivist 3 16.3 (10-27) 0 1 2 
Burn Surgeon 11 11.8 (0-16) 222 1 8 
Resident 18 2.1 (0-13) 17 0 1 
Fellow 9 5.9 (5-6) 0 9 0 
Nurse 25 14 5 6 
CN/CNS/HN 7 4.3 (0-12) 4 2 1 
Nurse 18 8.9 (0-35) 10 3 5 
Medical Student 13 2.5 (0-4) 13 0 0 
Other Provider 37 4 22 11 
Dietician 18 7.4 (5-10) 0 18 0 
OT 1 1 1 0 0 
Pharmacist 7 12.1 (2-24) 1 3 3 
Psychiatry Support 1 13 0 0 1 
RT| 10 12.6 (4-25) 2 1 7 
DEE es 
Total 116 50 38 28 
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Table 2. NASA-TLX subscale scores for all survey takers for completion of task 1 (“Identify if the patient is 
better, same, or worse than yesterday,” i.e. determine the severity of illness, SOl) and task 2 (“Identify 
the priorities of care today” or POC), ranked by median subscale score. This constitutes a rank-order list 
describing subscale contributors to overall workload, denoted as “Total” below. 


Task 1: Severity of Illness Task 2: Priority of Care 
Rank Order Average Score Average Score 
Subscale (1aR) Subscale (1aR) 
1 Mental 150 (90-210) Mental 120 (80-160) 
2 Effort 120 (80-160) Temporal 100 (60-140) 
3 Performance 100 (60-140) Performance 90 (50-130) 
4 Temporal 90 (50-130) Effort 90 (50-130) 
5 Frustration 20 (20-20) Frustration 20 (20-20) 
6 Physical 0 (0-0) Physical 0 (0-0) 
Total 40 (13-67) 43 (18-68) 
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users under the terms of the CC BY-NC-ND. 


b. If the Author has selected either “Research Councils UK (RCUK)” or “Wellcome 
Trust” in Item 1 of Schedule B and has selected “Gold Route” in Item 2 of Schedule B, 
the following shall apply: 


The Author acknowledges and agrees that the Work will be published by 
the Publisher in [INSERT NAME OF JOURNAL] (the “Journal”) and 
made freely available to users under the terms of the Attribution 3.0 
Creative Commons’ License, as _ currently’ displayed at 
http://creativecommons.org/licenses/by/3.0/legalcode (the “CC BY”). The 
Author acknowledges and agrees that that Publisher is the exclusive 
“Licensor”, as defined in the CC BY, of the Work and that the Publisher 
may make the Work freely available to all users under the terms of the CC 
BY, 


C. If the Author has selected either “Research Councils UK (RCUK)” or “Wellcome 
Trust” in Item 1 of Schedule B and has selected “Green Route” in Item 2 of Schedule B, 
the following shall apply: 


The Author acknowledges and agrees that the Work will be published by 
the Publisher in [INSERT NAME OF JOURNAL] (the “Journal”) and 
made freely available to users under the terms of the Attribution- 
NonCommercial 3.0 Creative Commons License, as currently displayed at 
http://creativecommons.org/licenses/by-nc/3.0/legalcode (the “CC BY- 
NC”). The Author acknowledges and agrees that that Publisher is the 
exclusive “Licensor”, as defined in the CC BY-NC, of the Work and that 
the Publisher may make the Work freely available to all users under the 
terms of the CC BY-NC. 


Royalties. 


The Author acknowledges and agrees that this Agreement entitles the Author to no 
royalties or fees. To the maximum extent permitted by law, the Author waives any and 
all rights the Author may have to collect royalties or other fees in relation to the Work or 
in respect of any use of the Work by the Publisher or its sublicensees. 


Miscellaneous. 
a. Assignment. This Agreement may not be assigned or transferred, in whole or in 


part, by either party without the prior written consent of the other party. Notwithstanding 
the above, the Publisher may assign this Agreement without the written consent of the 
Author (i) to an entity succeeding, whether by sale, merger or other corporate 
reorganization, to substantially all of the Publisher’s assets and business activity, or (ii) to 
a corporation or organization that obtains the right to publish the Journal from the 
Publisher. The Publisher may assign this Agreement to any of its affiliates. This 


3 


Agreement will be binding upon and inure to the benefit of the parties hereto and their 
respective successors and permitted assigns. 


b. Counterparts. This Agreement may be executed in two or more counterparts, 
each of which shall be deemed an original, but all of which together shall constitute one 
and the same document. Facsimile or Portable Document Format (PDF) signatures will 
be deemed original signatures for purposes of this Agreement. 


C. Entire Agreement; Amendment. This Agreement sets forth the entire agreement 
of the parties on the subject hereof and supersedes all previous or contemporaneous oral 
or written representations or agreements relating to the rights and duties provided herein, 
and may not be modified or amended except by written agreement of the parties. 


d. Force Majeure. Neither party shall be liable for any default or delay on its part in 
performing any obligation under this Agreement if such default or delay is caused by 
natural disaster, accident, war, civil disorder, strike or any other cause beyond the 
reasonable control of such party. In the event that either party is prevented by such an 
occurrence or circumstance for a period of more than ninety (90) days from fulfilling its 
obligations under this Agreement, the other party may terminate this Agreement upon 
thirty (30) days’ written notice. 


e. Governing Law. This Agreement shall be governed in all respects according to 
the laws of the State of New York without giving effect to the principles of conflict of 
law thereof. 


f. Headings. All headings are for reference purposes only and shall not affect the 
meaning or interpretation of any provision hereof. 


g. Severability. If any provision of this Agreement is held to be illegal, invalid, or 
unenforceable under the present or future laws, then such provision shall be revised by a 
court of competent jurisdiction to be enforceable if permitted under applicable law, and 
otherwise shall be fully severable. In any event, this Agreement shall be construed and 
enforced as if such illegal, invalid, or unenforceable provision had never comprised a part 
of this Agreement, and the remaining provisions of this Agreement shall remain in full 
force and effect and shall not be affected by the illegal, invalid, or unenforceable 
provision or by its severance from this Agreement. 


h. Status of the Parties. The parties are independent contractors. Nothing in this 
Agreement is intended to or shall be construed to constitute or establish any agency, joint 
venture, partnership or fiduciary relationship between the parties, and neither party has 
the right or authority to bind the other party nor shall either party be responsible for the 
acts or omissions of the other. 


1. Waiver; Amendment. The waiver by either party of or the failure by either party 
to claim a breach of any provision of this Agreement shall not be, or be held to be, a 
waiver of any subsequent breach or affect in any way the further effectiveness of any 
such provision. No term or condition of this Agreement may be waived except by an 
agreement by the parties in writing. 


j. Waiver of Jury Trial EACH PARTY HEREBY WAIVES ITS RIGHT TO A 
JURY TRIAL IN CONNECTION WITH ANY DISPUTE OR LEGAL PROCEEDING 
ARISING OUT OF THIS AGREEMENT OR THE SUBJECT MATTER HEREOF. 


[Signature Page Follows] 
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Title: 
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This Schedule A must be completed by Author in its entirety. The Publisher is unable to 
publish the Work unless this Schedule A is completely filled out. 


Article Tracking #: | JBCR-D-15-00153 


Article Title (the “Work”): | Comparing the workload perceptions of identifying patient condition 
and priorities of care among burn providers in three Burn ICUs 


Corresponding Author Name (the “Author’”) (please print): Jeremy C. Pamplin 
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Name of Journal in which Work is to be Published: The Journal of Burn Care & Research 


Schedule B 
This Schedule B must be completed by Author in its entirety. The Publisher is unable to 
publish the Work unless this Schedule B is completely filled out. 


PUBLIC ACCESS POLICY FUNDING DISCLOSURE 


1. Please disclose below if you or any other author of the Work has received funding for research on 
which the Work is based from any of the following organizations: 


[] National Institutes of Health (NIH) 
L] Howard Hughes Medical Institute (HHMI) 
L] Research Councils UK (RCUK) (Please complete Item 2) 


L] Wellcome Trust (Please complete Item 2) 


2. If you have selected either Research Councils UK or Wellcome Trust from the above list, please 
disclose the Open Access option to which the Work will be subject: 


LL] Gold route 


L] Green route 


NOTE: If the “Gold” route has been selected, Section 3.b. of the Agreement will apply to the 
Work, and neither Section 3.a. nor Section 3.c. of the Agreement will apply to the Work. If the 
“Green” route has been selected, Section 3.c. of the Agreement will apply to the Work, and 
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Appendix C 


CORE Site (USAISR) Tools 


1. 
. Original Scales Tool 

. Updated TeamView 

. Updated ECMO TeamView 

. Updated Resident Scales/Checklist/Presentation Tool 
. Updated Nurse Scales/Checklist/Handoff Tool 


Oo oR W PD 


Original TeamView 


Team View Patient Severity of Illness, Status, and Goals 


Severity of Illness (transfer from scales tool) 


Status 


% Open 


Hrs Sleep Last Night 


Coordinating 
Activities 

See code list behinde 
Scales Tool for codes. 


Update Checklist items daily! ‘ 
NAGood _ Discuss 


GI Prophylaxis 

CHG Prophylaxis 

HOB > 30 degrees 

DVT Prophylaxis 

Last BM < 48 hrs ago 
Respiratory Orders Current 
Family has questions 
Delirium Positive 

Pending Cultures 


Antibiotic(s) NAC Effective Start Date Planned Stop Date Diagnosis 


O/0)0/0)0)0 


0/0) 0/0) 0/0) 0) 0/0 


Goals (completed during rounds) Major Goal(s) for the next 24-48 hours: 


Fluid volume goal for today: 
L] Positive 

L] Negative 

L] Even 


A. Patient’s Current Condition. Room: Date/Time: 


Please make a noticeable “X” ANYWHERE on ANY of the scales below that indicates your estimate of the patient’s condition right now. 


Diagnoses & Problems worse = Increasing in number or severity; Better = Decreasing in number or severity 


Getting Worse Quickly Worse Same Better Better Quickly 


Organ support (Mechanical Ventilation, CRRT, Vasopressors, Blood Products, Etc.) 


Maximal or High, new, or increasing Stable in amount Low or Decreasing Permanent or Chronic None 
Increasing rapidly in amount or number or Number in amount or number 


Mental Status 
MMT TTT TTT TTT TTT TTT 
Paralyzed Comatose Agitated Delirium Hypoactive Delirium or Alert, Normal, [Baseline 
Sedated or Follows Commands 
Encephalopathy 
Acuity Level 
| 
Highest/Very Complex High or Increasing Standard or Decreasing Low 
Wounds 
Fungus/necrosis Unexcise thickness Stable Healing Small/Minima' 
Wound Fialure (<20% healed @ 3 weeks Delayed healing < 50% @ 3 weeks < 10% Open 
Risk of Worsening or Sepsis 


High Medium Low 


Severity of Illness (your summary assessment of the above scales) 


Most sick, Least Sick 
Could Die Could transfer 


B. Patient’s Current Treatments 
Make a noticeable “X” ANYWHERE the scales below that indicates the patient’s current treatments. 
Text in each section is organized by objective/goal in bold type, recommendations in regular type, and considerations in italic type. 


Analgesia & Sedation 
—wTawz TTT iii ooo 
Deep Sedation +/-Paralyzed Moderate Sedation (RASS Light Sedation (RASS No Sedation (RASS 
*Decrease O, Consumption *Safety and Cane. *Patient eee sineet =o pesos ta on 
Continuous + PRN Scheduled/PRN Narcotics PRN/Scheduled Narcotics PO/Enteral PRN Narcotics 
Narcotics and Sedatives PRN Sedatives +/- Scheduled Enteral Narcotics Symptomatic Tx of Anxiety 


Sleep Goal: Minimize Delirium 


As Able Goal 4-6 hours Use Sleep Protocol 


Day/Night Cycle Avoid awakening 4-6 hrs at night Avoid awakening 6-8 hrs at night 
Day/Night Cycle Day/Night Cycle 
Sleep aid 


Ventilation Goat: minimize vil, liberation ASAP 


IMT TTT TTT TTT TTT TTT TTT TTT TTT 
Controlled/Assisted Wean/Decrease with Supported Mode Spontaneous/Liberated 
(vent does Work of Breathing) Transition to APRV or CPAP or CPAP/PS Transition to CPAP, extubate, or trach collar 
Low Tidal Volume (Vt) or VDR Decrease FiO) First, then PEEP/MAP Tracheostomy, speaking valves 
Open Lung Approach: SPEEP, Vt 


Monitoring Standard monitoring (Tele, SpO2, RR, NBP) plus the following: 


a_i 
Maximize knowledge Assure effective Ventilation & Sedation Compatible 
A-Line, CVP, EV1000, EtCO, (Standard ICU) Decrease NBP eee overnight 
Continuous SvO2, Abdominal EtCO,, Remove Foley 
Pressures, [TTE/IVC measurement] A-Line, +CVP 


Nutrition Goat: minimize loss of lean mass 


Holding Enteral Feed, Enteral Feeds at Enteral feeds Full Support Full Support Full support 
Consider TPN Trickle (20mL/hr) Increasing to full support Enteral Enteral and PO including PO solids and supplements 
supplements 


Fluid Goal Goal: Maintain organ perfusion; Avoid volume overload 
MTT TTT TTT TTT TTT TTT TTT 

Targeted Resuscitation/No over resuscitation Targeted Management for Euvolemia Self-Management of Fluid Balance 

Give fluids only to achieve defined goal Assess intravascular volume status daily No maintenance fluids 

Lactate decrease by 10% in 4 hrs Define Goal of Positive, Negative, or even 

ScvO, > 70%, UOP > 0.5ml/kg/hr Fluid challenge 

Blood and Colloids to avoid over resuscitation Diuretic challenge 


CRRT (Check if NAD) 
0 iii 


Consider High Dose Therapy Regular Dose Breaks for activities and tests Consider IH. 


Labs Goal: Information availability & minimize blood loss 


More Frequent Less Frequent As Needed/Intermittent 


Q4-Q6: ABG, VBG/SvO,, Lactate, CBC, Chem Q12-Q24: ABG, CBC, Chem QOD-QMWF: CBC, Chem 
Q12-24: LFT Q24-Qweek: LFT, Coags Quweek: LFT, Coags 
*Pedi Tubes*, TEG, Coags, Fibrinogen Weekly Nutrition Labs PRN Labs only 
Access 


Adequate access Balance access and Infection Minimize Infection 
Central line 2 3 ports Remove arterial line Peripheral, fewer 
Arterial Line If on CRRT, Triple lumen dialysis catheter as Power Wand 
only central access PICC 


Wound Care Goal: minimize wound infection, Suffering, & Heat loss 


Complex dressing, NPWD 30-40% mod complex or shower Smaller or basic dressing or postop with Simple/Self-care 
placement/takedown > 40% or type < 2 hours or no post op wet downs, <20% 

Ig dressing with shower/staple dressing change 

removal 


Rehabilitation 
MMT TTT TTT TTT TTT TTT TTT TTT TTT TTT 
Total Care As much as tolerated Minimal Assist 
None or ROM/Positioning as General Progression: ROM -> Sit/TLC -> Dangle/Tilt/Stand to March/Walk -> Gym & Outside! 
tolerated Rehab likely more important Rehab most important, DO NOT DELAY 


Other care is important 


Medications Goal: winimize polypharmacy 


ee eT 
More continuous Continuous + PRN PRN + More Scheduled More P 
More IV More IV + Enteral Mixed IV + Enteral Some sae 


Some PO 


Team View Patient Severity of Illness, Status, and Goals 


Seve rity of Illness (transfer from condition assessment tool) Allergies’ Code Status 
Date| | | | | | | | | | | | | | | | | | | 
Hosp. Day/ICU Day /1 /2 /3 /4 /5 /6 /7 /8 /9 /10 /11 /12 /13 /1 /15 /16 /17 /18 /19 /20 /21 


Status 


% Open 
OR 
Central Line 


Arterial Line 


Dialysis Cath 


Extubation 
Intubation 
BM 


Cultures 


Dressings| 
“Down-Day” 
Rehab| 
Completed 
Other 
Events| 

(e.g. family 
meeting, etc.) 


Circle planned events 


Place “X” or description where these occur and and the 
days post procedure in the boxes above the blue line. 


Recommendations/Messages Antibiotic(s) NAO Effective Start Date Planned Stop Date Diagnosis 


Goals (completed during rounds) The most important goal(s) for today (what we must do to be successful): _ Priorities: 


Fluid volume goal for today: ___WoundCare ___ Rehab 
L] Positive L ____ Procedure(s) ____ Imaging 
L] Negative L ___ SH/BT ___ Extubation 


L] Even= + L Other 


Team View Patient Severity of Illness, Status, and Goals 


Severity of Illness (transfer from scales tool) Allergies Code Status 


Date 
HospDay/ECMO Day /1 /2 /3 /4 /5 /6 /7 /8 /9 /10) /11 /12 /13 /14] /15 /16| /17 /18) /19| /20| /21 


Status 


Flow/ RPM 
Delta P 
Circuit PaO2 
Sweep 
Patient PaO2 
Patient PaCO2 


Compliance 
PRBC 

FFP 

PLT 

Cryo 
Amicar/TXA 
Rehab 


Other Events 
(e.g. Procedures) 


Recommendations/Messages \Antibiotic(s) NAO Effective Start Date Planned Stop Date Diagnosis 
Goals (completed during rounds) The most important goal(s) for today (what we must do to be successful): _ Priorities: 
Fluid volume goal for today: ___ Wound Care ___ Rehab 
L] Positive L ___ Procedure(s) ____ Imaging 
L] Negative L ___ Other 


L] Even= + L 


Step 1 


Page 1: Nursing liiness Severity Assessment 


Instructions: Make a noticeable “X” ANYWHERE on ANY of the scales below that indicates your estimate of the 
patient’s condition right now. Use the “average” of these marks to identify the Illness Severity (summary assessment) 
at the bottom. Transfer that summary assessment to the scale at the top of Page 2. 


Acuity PU TTTTTCRTUTTRAURTURTOOLOUAAURORAOOLONLOOLAOAHOOUAONAOULONHOOHIOLIOLTORTOOHONIONTORTNORORTOOD 
Worse Standard or Decreasing/Moderate Minimal/Low 
Very Complex >>>>>>Getting Better>>>>>>>>>>>>>>>>>>>>>> Complexity 
MD rounding < Q2 hrs! 2-7 Drips Q12-24 hr labs, 1-2/day 
8-9 Drips Q6-24 hr labs, 1-4/day Standard ICU Monitoring 
2Q6 hr labs, > 6/day Arterial Line (Foley, Tele, SpO2, +/- 
CO Monitoring, EtCO2 CVvP) 
Diagnoses & Problems ITETVEVCUTVVTVTUTTTTTTTTTTEEEETTTETUT TTT TUTTETEETETEEETETETEETETTTTTTTTTTETETTETEEEEEETTETT TTT 
Current or Chronic Problems: <<< Getting Worse <<<< Same >>>> Getting Better >>> Baseline 


Worse = Increasing in number or severity; Better = Decreasing in number or severity 


Neuro/Pain 
RASS -4 to -5 RASS -1 to -3 RASS 0 to -1 RASS 0 
Paralyzed 
Respiratory DUTT NTTNTTTTTT TTT ATT TTT TTDI TTT ATT TTT TTT TTT TTT TTT TATTLE TTT TTT TTT TTT TTT TTT TTT TTT TTT TTT TTT TTT 
Low Tidal Volumes PCV, VDR, or APRV APRV or CPAP/PSV Off-Vent 
PEEP>16 or MAP>28 PEEP>12 or MAP>18 Breathing Trials Chronic vent 
iNO Weaning 
Rotaprone 
100% FiO2, 70-80% FiO2 40-60% FiO2 < 40% Fi02 
P:F < 100 or OI>35 P:F 100-200 or OI > 25 P:F >200 or Ol > 14 P:F > 300 or O1< 15 
SpO2 < 90 SpO2>90 SpO2 > 90 SpO2 Normal or 
Baseline 
Cardiac DULTTTDETTTTTTTTTETTTTET TTT TTTTTTTTTTTTT TTT TTTTTTTTTT TTT TTTTTTT TTT TTT TTT TTT TTT TTT TTT TTT 
Levophed > 25 Levophed < 25 Levophed < 25 No Vasopressors 
Vasopressin 0.04 Vasopressin 0.04 
pH< 7.2 pH 7.2-7.3 or > 7.5 pH 7.3-7.5 
Lactate > 6/increasing Lactate decreasing or normal Not checking 
Trending ScvO2 often lactates 
Gl 
Renal/GU UUUTT ULV TET TETD TTT UTTTTTTTTT TTT ETE TTTTTTTTTTETTTTTETTT TE TETTTTTT TTT TE TTT TTT ET TTT TT TTT TET TTT TTT 
High volume CVVH CVVH None or IHD 
Endo Accuchecks: 
Heme DLTTTTT TTT TTTTATT TTA TTT TTT TTT TTT TTT TTT TTT TTT TT TTT TTT TTT TTT TTT TT TTT 
Belmont in the room Fluid loading Goal Negative or Even 
Blood Products Given: PRBC FFP PLTS Cryp 
Labs/ABG/pH 
> Q6 Q6-Q24 <Q24 
K > 6 or ECG changes DIC Normal 
DIC with bleeding 
Skin/Wounds TULTENTUNTTLTTDTTTTTTTUTTTTTTTTTTTTTTTTTTT TT TTTTTT TTT TTT TTT TTT TTT TTT TTT TTT TTT TTT 
Bad (IFI or Necrosis) Not Bad Good 
Extensive (> 70% open) Medium Sized (20-70% open) Small (< 20% open) 
Rehabilitation DEUTTTTTTETTTUTTTTTTT TTT TETTTTTTATTTTTTTTTTTETT TTT TTT TTTTT TTT ETT 
None ROM>>>>>>>>>>>>>>>>>>>>>>>>>>> >>> >>> >>> >> >> >>> >>> >>> PPP PPP > PPP PPP PPP PP PPP PPPPPP> 
Sitting/TLC>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
Stand/Tilt>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
Walking>>>>>>>>>>>>> 
ID Tmax: WBC: ABX: Day/Reason: 
Risk of Worsening ULTTEVTTLTUTTTTTTTTTTTE TT TTTTTTTTTTTTTTTTTTT TTT TTTTTT TTT TTT TTT TTT TTT TTT TTT TTT 
High = Any of the Following Medium Low = All of the following 
WEC (> 15/rising or < Febrile Normal/Stable WBC 
4/dropping) Not tolerating rehabilitation Normal Temperature 
Hypothermic (< 36/<96.8) Increasing Gastric Residuals Normal Vital Signs 
Worsening Mental Status Increasing Blood Glucose or Tolerating feeding 
Increasing HR or RR, or Insulin Requireement Stable insulin requirment 
decreasing MAP Tolerating rehabilitation 
Severity of Illness 
(summary assessment) Most sick, Least Sick 
Could Die Could transfer 


**Copy to the Next Page** 


If the patient’s SOI changes by 2 or more blocks, page the on-call resident or attending to discuss. 


Page 2: Assessment & Feecommendations: Patient’s CURRENT Treatments 


| Step 3. Instructions: 


- Mark current treatments. 
- Note discrepancies between current treatments & the intended treatments according to patient condition. 


Severity of Illness 


Analgesia & Sedation 


Notes/Recommendations: 


Intubated Patients Only 


Deep Sedation 
(RASS -4 to -5) 
+/-Paralyzed 
Non-Responsive 
O minimize oxygen 
demand 
OO maximize perfusion 
O protect grafts 
0 Continuous 


+ 
O PRN 


Moderate Sedation 
(RASS -1 to -3) 
Arousable 


Light Sedation 
(RASS 0 to -1) 
Interactive 
(opens eyes, withdraws) (follows commands) 
O patient ventilator synchrony O prevent patient harm 
O prevent agitated movements O engage patient in care 
O protect grafts, OO more physical/occupational 
tube/line/device therapy 
0 Continuous D1 Scheduled 1V/Enteral/Po 


+ + 
O PRN 1 PRN IV or Enteral/PO 


Intubated and Non-Intubated Patients 


No Sedation 
(RASS 0) 
Participatory 
(expresses self) 

XC maximize patient 
engagement & 
participation in care 

O1 maximize rehabilitation 

D1 Scheduled Ww or 

Enteral or PO + 


C1 PRN Enteral > IV 


Delirium 


Notes/Recommendations: 


O Day-Night Light Cycle 


ONA 


Sleep aide dose: 
Restraints: Y/N 
Hours of Sleep: 


O Day-Night Light Cycle 

0 Un-Interrupted Sleep, 4-6 hrs 
O Physical activity 

O Consider ear plugs 


OD Dexmedetomidine drip 
O Haloperidol IV Push 


Day-Night Light Cycle 
Sleep, 4-8 hrs 
Increase mobility 
Consider ear plugs, 
sleep aid 

Haloperidol IV Push 
Quetiepine PO/Enteral 


OO OOOO 


Notes/Recommendations: 


OC ARDS Algorithm 


OO CPAP/PSV Protocol 
O Daily breathing trials and/or wean 


Monitoring/ Maximize knowledge Assure effective Ventilation & Sedation Ward Compatible 
, Standard ICU Plus: Standard ICU Plus: O Standard ICU 
Lines Trend: O Continuous C1 Foley Consider: 
Standard monitoring Cl Abdominal CO/SVv/SVR C1 Etco2 CO Decrease NBP 
(Tele, SpO2, RR, NBP) , measurements 
Pressures C1 A-Line overnight 
OOTTE/IVC size Cl tcvP Oo Remove Foley 
Lines: 
Notes/Recommendations: 
Mechanical O Paralysis 0 VDR Protocol OO APRV Protocol 0 CPAP/CPAP-PS Protocol 
i * O PCV Protocol O Oscillatory/Demand CPAP protocol O Trach collar/speaking 
Ventilation 


valve 


CNA, not on mechanical 
ventilation 


Notes/Recommendations: 


OD ROM/Positioning 
Q2hrs 
O Splinting 


U1 Bed-to-Chair Position/Cardiac Chair > 
O Danlge/Tilt/Stand 
O Splinting 


Nutrition 0 Holding Enteral O Goal = full enteral support O Goal is transition to PO 
Feeds O If unable to achieve, use TPN solids and supplements 
O Consider TPN 
Notes/Recommendations: Last BM: Steroids: Y/N 
FMS: Y/N PPI: Y/N 
TF Goal: 
Q4-Q6: Q8-Q24: Q24-QOD: 
Labs 0 ABG Consider: asc Ccsc 
O vBG/SvO2 LI TEG Ocec OChem 
O Lactate XO Coags CO chem LC Qweek: 
O cBc O Fibrinogen OLet OLFT 
O Chem Q12-24: pois 
CLFT OO Coags Consider: 
C Drug Levels Consider: Ee Deven 
iteea rice Cibrug bevels COPRN Labs only 
Notes/Recommendations: 
Rehabilitation None or As Able As Tolerated to Maintain or Improve Function Improve Function 
C1 None or O General Progression: ROM > Oto March/Walk > 


O1Go Outside! 
O Splinting 


If all checks are not aligned with the the patient’s SOI, discuss with the physicians. 


Notes/Plan 


Step 1 


Page 1. Burn limness Severity Assessment 
Bed #: Time/Date: 


Instructions: Make a noticeable “Xx” ANYWHERE on ANY of the scales below that indicates your 
estimate of the patient’s condition right now. Use the “average” of these marks to identify the Illness 
Severity (summary assessment) at the bottom. Transfer that summary assessment to the scale at the 


top of Page 2. 
Acuity 
Worse Standard or Decreasing/Moderate Minimal/Low Complexity 
Very Complex >>>>>>Getting Better>>>>>>>>>>>>>>>>>>>>>> 
MD rounding < Q2 hrs! 2-7 Drips Q12-24 hr labs, 1-2/day 
8-9 Drips Q6-24 hr labs, 1-4/day Standard ICU Monitoring 
2Q6 hr labs, > 6/day Arterial Line (Foley, Tele, SpO2, +/- CVP) 
CO Monitoring, EtCO2 
Dingmoses& — ULV LTILTILLILTTUTTNLTINTILLTELVITT TUTTE TTLTITTTUTTTTTEETITTTTTT TTT TETTTTTTTTTTTTETTTTTITTTTTTTTTL 
Problems Bad <<< Getting Worse <<<< Same >>>> Getting Better >>> Baseline 
Current or 
Chronic: 
OrganSupport 
Sedation Goal RASS -4to-5 RASS -1 to -3 RASS 0 to -1 RASS 0 
Paralyzed 
Low Tidal Volumes PCV, VDR, or APRV APRV or CPAP/PSV Off-Vent 
PEEP>16 or MAP>28 PEEP>12 or MAP>18 Breathing Trials Chronic vent 
iNO Weaning 
Rotaprone 


Vasopressors Levophed > 25 Levophed < 25 Levophed < 25 


Vasopressin 0.04 


No Vasopressors 


High volume CVVH CVVH None or IHD 
Blood & Fluids Belmont in the room Fluid loading Goal Negative or Even 
Labs/ABG/pH 
Frequency >Q6 Q6-Q24 <Q24 
pH< 7.2 pH 7.2-7.3 or > 7.5 pH 7.3-7.5 
Lactate > 6/increasing Lactate decreasing or normal Not checking lactates 
Trending ScvO2 often 
Electrolytes or K>6orECG changes DIC Normal 
Labs DIC with bleeding 
Respiratory 
FiO2/Oxygen 100% FiO2, 70-80% FiO2 40-50% FiO2 < 40% FiO2 
(P:F, Sp02) p:F < 100 or Ol>35 P:F 100-200 or Ol > 25 P:F >200 or Ol > 14 P:F > 300 or O1< 15 
SpO2 < 90 SpO2>90 SpO2 > 90 SpO2 Normal or Baseline 
Wounds 
Bad (IFI or Necrosis) Not Bad Good 
Extensive (> 70% open) Medium Sized (20-70% open) Small (< 20% open) 
Rehabilitation 
None ROM>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >> >>> >> >> >> >>> >>> > >>> > >>> >> >>> > >>> > >>> > >>> 
Sitting/TLC>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
Stand/Tilt>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
Walking>>>>>>>>>>>>> 
Risk 
Of Worsening High = Any of the Following Medium Low = All of the following 
WBC (> 15/rising or < 4/dropping) Febrile Normal/Stable WBC 
Hypothermic (< 36/<96.8) Not tolerating rehabilitation Normal Temperature 
Worsening Mental Status Increasing Gastric Residuals Normal Vital Signs 
Increasing HR or RR, or decreasing Increasing Blood Glucose or Tolerating feeding 
MAP Insulin Requireement Stable insulin requirment 
Tolerating rehabilitation 
Illness 
Severity 
(summary Most sick, Least Sick 
assessment) Could Die Could transfer 
*Copy to Next 


Page* 


If the patient’s SOI changes by 2 or more blocks, discuss during a “huddle.” 


Review QA checklist daily. Discuss problems on rounds. 


NA Yes No NA Yes No 
Appropriate GI Prophylaxis (PPI if > 20%TBSA)? O CO __ Respiratory orders current? OO OQ 
Appropriate DVT Prophylaxis (Medical if > 7 
20%TBSA)? ( © Wound care order current? O QO O 
Receiving appropriate oral care (CHG Q6 if : : ; er 
intubated, BID teeth brushedif not)? L) O OC © Family has questions to discuss (ask nursing)? O O 
HOB > 30 degrees (higher if indicated)? Ol OC _ Delirium Positive? O O 
Last BM < 48 hrs ago? Ol CO Restraints needed? O O 
Poivehanmacwimintaized (orders “cleshed?)? od Current treatments match current condition og 


(see next page)? 


Page 2. lIliness Severity Checklists 
| Step 3. Instructions: Mark current treatments in the white areas. Note discrepancies between current treatments & the 
intended treatments according to patient’s severity of illness. Present information in grey on rounds. 
One Liner: 
24 hr events/rehab tolerance/Subjective: 
Severity of Iliness 
Analgesia & Sedation Intubated Patients Only Intubated and Non-Intubated Patients 
Deep Sedation Moderate Sedation Light Sedation No Sedation 
(RASS -4 to -5) (RASS -1 to -3) (RASS 0 to -1) (RASS 0) 
+/-Paralyzed Arousable Interactive Participatory 
Non-Responsive (opens eyes, withdraws) (follows commands) (expresses self) 
LO minimize oxygen OO patient ventilator C1 prevent patient harm XC maximize patient 
demand synchrony CJ engage patient in care engagement & 
° CO maximize perfusion LU no agitated movements OJ more physical/occupational participation in care 
a OO protect grafts OC protect grafts, T/L/D therapy CO maximize rehabilitation 
2 CO Continuous + PRN C1 Continuous + PRN 0 Scheduled IV/Enteral/PO U1 Sched. IV/Enteral/PO 
+ PRN IV or Enteral/PO + PRN Enteral > IV 
Delirium O Day-Night Light Cycle XO Day-Night Light Cycle O Day-Night Light Cycle 
CJ Un-Interrupted Sleep, 4-6 hrs O Sleep, 4-8 hrs 
OO Physical activity O Increase mobility 
CO Consider ear plugs O Ear plugs, sleep aid 
ONA LC Dexmedetomidine drip O Haloperidol IV Push 
CO Haloperidol IV Push O Quetiepine PO/Enteral 
Exam (Pupils/MS/Focality) Current Narcotics/Dose last 24 hrs Notes/Plan: 
GCS: CAM ICU: Hrs of sleep: Current Sedatives/Dose last 24 hrs 
Imaging: Other meds 
Mechanical O Paralysis 0 VDR Protocol DO APRV Protocol 0 CPAP/CPAP-PS Protocol 
= . O PCV Protocol O Oscillatory/Demand CPAP protocol O Trach collar/speaking 
& Ventilation CARDS Protocol 1 CPAP/PSV Protocol valve 
O NA, not on mech. ventilation O Daily breathing trial and/or wean O No Daily CXR 
ECMO Pt ABG VDR: PIP PEEP. OsPEEP MAP FIO2 
LPM RPM. Pt SvO2. AC: Vt. mL/kg. f(set/tot) Peep FiO2 Ppk. Pplat. 
VenPres. ArtPres APress Circuit PaO2 PC: PIP. f(set/tot) Peep. FiO2 Vt ml/kg 
SweepFlow. FiO2 PS: PS. PEEP fi FiO2 Vt ml/kg. 
APRV: PH PL TH TL FiO2 Vt MVtot/spont 
RR/Sats: Exam: ABG P:F OI[(MAPxFiO2)/Pa02] Notes/Plan: 
Monitoring Maximize knowledge Assure effective Ventilation & Sedation Ward Compatible 
sate Standard ICU Plus: Standard ICU Plus: O Standard ICU 
Standard monitoring : ; 
S (Tele, SpO2, RR, NBP) Trend: O Continuous CO Foley Consider: 
oO pee EN: OO Abdominal CO/SVV/SVR CL Etco2 O Decrease NBP 
Pressures O A-Line measurements 
OTTE/IVC size C1 +cvp overnight 
OX Remove Foley 
HR BP MAP. cVvP. co/cl SVR Lactate/SvO2: Notes/Plan: 
Exam Pulses: Meas: 
= Nutrition 0 Holding Enteral Feeds OO Goal = full enteral support O Goal is transition to PO 
oO C1 Consider TPN C1 If unable to achieve, use TPN solids and supplements 
Exam: LFTs/Amy/Lip Notes/Plan: 
Imaging: PreAlb/UUN/Metabolic Cart: 
Feeding Residuals: Last BM Meds: 
Labs Q4-Q6: Q8-Q24: Q24-QOD: 
DOABG, Consider: CABG, CBC, Chem, LFT, Coags CICBC, Chem 
SvO2, LI TEG, Coags Consider: Qweek 
Lactate, OO Fibrinogen O Drug Levels OLFT, Coags 
CBC,Chem Q12-24: Consider: 
OO LFT OPRN Labs only 
CO Drug Levels 
| (o} Net UOP/hr. CRRT: Prisma CNxStage BFR RFR Solution UF 
Est Insens loss (1cc/kg/tbsa) Anticoagulation Filter Life (hrs) 
S Weight. Dose (RFRxHrs on/24/kg) FF. 
F Drain OP: Gastric CT’s JP’s NPWD Other(s) Notes/Plan: 
= Other Studies: 
Cc M Pp IV Drips: 
< Meds: 
FSBGs. Insulin Tot. Meds: Notes/Plan: 
Endo Other (TSH,Cortisol, etc.) 
TEG-R a MA Ly30 RBCs FFP. PLT. Cryo. Notes/Plan: 
Heme _— Others: Other 
Tmax/TCurrent WBC/Diff Notes/Plan: 
Cultures ABX (Day#/of#) & Levels 
Q 
Rehabilitation None or As Able As Tolerated to Maintain or Improve Function Improve Function 
O None or O General Progression: ROM > to March/Walk > 
U0 ROM/Positioning Q2hrs O Bed-to-Chair Position/Cardiac Chair > O1Go Outside! 
O Splinting O Danlge/Tilt/Stand OSplinting 
OO Splinting 
Whnds _ | Exam: Current % Open: Current Wound Care: Notes/Plan: 
Last OR Next OR: Next Dressings Down Day: 
T/L/D CVC Location/Day. ETT (size/depth) Notes/Plan: 
AL Location/Day Foley(day) FMS(day/last DRE) 
NGT/DHT: Other: 


Houston Site Tools 
1. Original TeamView 
2. Original Scales Tool 


A. Patient’s Current Condition. 


Room: Date/Time: 


Please make a noticeable “X” ANYWHERE on ANY of the scales below that indicates your estimate of the patient’s condition right now. 


Acuity 


Highest/Very High or Increasing/Many Standard or Decreasing/Moderate Minimal/Low Complexity/Few 
Complex/Most 


Diagnoses & Problems 
Problems of systems: 

Neuro, CV, Pulm, Gl, Renal, Endo, ID, Heme, 
MSK, etc. 


Getting Worse Quickly Increasing Support <<<<<< Getting Worse >>>>>>>> Baseline 
Same 
>>>>>>>>>Getting Better >>>>>> Decreasing Support 
Worse = Increasing in number or severity Better = Decreasing in number or severity 


General Condition 


Getting Worse Quickly Worse or Same Baseline Normal 
Same or Getting Better Getting Better Quickly 


Organ Failures 


Brain, Lungs, Heart, Vascular, Bowel, Liver, MODS (23 1-3 systems 1-2 Systems 1 System None or Chronic 
Kidney, Coagulation, Skin systems) 
Organ support is PT UR UA URURURUDUOU RRO RUOURUROAUOURORUOUOORURUOUOURURUOUOURURUHUOURURUDUOURURDOUEURURUOUOURURDOUED 
Mechanical Ventilation, RRT, Maximal or High, new, or increasing Stable in amount Low or Decreasing Permanent or Chronic None 
Vasopressors, Blood Products, Etc. Increasing in amount or number or Number in amount or number 

rapidly (“Weaning”) 


Labs/ABG/pH 


Frequent labs to monitor Daily or more frequent labs that show Daily, less frequent, or PRN labs that are Normal or 
Acidosis/Shock/Major Derangement Acidosis, Electrolyte abnormality(ies), coagulopathy, Baseline 
pH< 7.2, Lactate > 4, SvO2 < 60% anemia, or changing organ function (better or worse) 
Major electrolyte abnl (e.g. K > 6) 


Mechanical Ventilation 
Peep/Mode 


High PEEP > 15, Increasing Support, Support Not Changing Extubated/Off Ventilation or Chronic 
Not Tolerating, Significant Dyssynchrony CPAP/PS or Trach Collar 
>>>>>>>>>> Decreasing Support >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 


FiO2/Oxygenation (P:F, Sp02) 


100% FiO2, P:F < 100, 70-80% FiO2, P:F 100-200 40-50% FiO2 P:F >200 < 40% FiO2, P:F > 300 
SpO2 < 90 SpO2>90 SpO2 > 90 SpO2 Normal or Baseline 


Monitors/Interventions 


Many or Increasing and invasive: >>Decreasing or few & less invasisve: Monitors, Drips, T/L/D>> No IV Drips or Invasive 


Monitors, IV Drips, Tubes/Lines/Drains <<<<<<<<<Increasing Monitors, IV Drips, T/L/D<<<<<<<<<< Monitors (except Foley) 


Mental Status STUUR UR URURUAUOU RRO ROU RUROOUOURORUAUOURORUOUOURURUODOUROROOUOURURUOUOURURUOUEURURDOUOURURDOUED 
Paralyzed Very Diminished, Grimaces Only Agitated Delirium Hypoactive Delirium or Alert, Normal, Baseline 
Comatose,Sedated or Follows Commands 
Diminished 
Wounds PT URURUR UREA AUOURURORUUURUROOUOURORUOOOURORUDUOURURURUOURURUOUOURURUHOOURUROUEURURUOUOURORDOUED 


OPre-Operative 
DPost-Operative 


Risk of Worsening or Sepsis 


Large/Extensive Medium Sized Small/Minimal 
Deep burns Mized Burn Depth Superficial/Superficial Partial Only 


High = All of the Following Medium Low = All of the following 
High WBC (> 15/rising) or Febrile Normal/Stable WBC 
Low WBC (< 4/dropping) Not tolerating rehabilitation Normal Temperature 
Hypothermic Increasing Gastric Residuals Normal Vital Signs 
Worsening Mental Status Increasing Blood Glucose or Insulin Tolerating feeding 
Increasing HR or RR, or Requireement Stable insulin requirment 


decreasing MAP 


Tolerating rehabilitation 


Severity of IlIness 
(summary assessment) 


Most sick, 
Could die today 


Leaset Sick, 
Could transfer today 


B. Patient’s Current Treatments 
Make a noticeable “X” ANYWHERE the scales below that indicates the patient’s current treatments. 
Text in each section is organized by objective/goal in bold type, recommendations in regular type, and considerations in italic type. 


Analgesia & Sedation 


Maximal/Controlled Sedation Moderate Sedtion Light Sedation No Sedation More Awake 
Fentanyl & Versed +/- (RASS -3 to -2) (RASS -2 to -1) (RASS 0) 
Paralyzed *Arousable Patient *Weaning *Participatory Patient 


IV Continuous + IV Scheduled & 
PRN Narcotics and Sedatives 


IV/Enteral Scheduled/PRN Narcotics & Sedatives PO/Enteral PRN Narcotics 


+/- Scheduled Enteral Narcotics 


PO/Enteral PRN Narcotics 
Symptomatic Tx of Anxiety 


Mechanical Ventilation 
Goal: Minimize VILI, 
liberation ASAP 


Controlled/Assisted 

(vent does Work of Breathing) 

VDR or Low Tidle Volume (Vt) AC/VC 
Open Lung Approach: SPEEP, Vt 


Spontaneous/Liberated 
Sedation Holiday/Breathing or Trach Tiral 
CPAP, extubate, or trach collar 


Wean/Decrease with Supported Mode 
Transition to 
APRV or CPAP or CPAP/PS or AC/VC 
Sedation Holiday/Breathing Trial 


Labs 


Goal: Information availability 
& minimize blood loss 


Normal (As Needed/Intermittent ) 
QOD-QMWF: CBC, Chem 
Qweek: LFT, Coag 
PRN Labs only 


Less Frequent/Daily 
Q12-Q24: ABG, CBC, Chem 
Q24-Qweek: LFT, Coag 
*Pedi Tubes* 


More Frequent 
Q4-Q6: ABG, VBG/SvO;, Lactate, CBC, Chem 
Q12-24: LFT 
TEG, Coags 


Sleep 


Goal: Minimize Delirium 


As Able 
Day/Night Cycle 


Goal 4 hours 
Avoid awakening 4 hrs at night 
Day/Night Cycle, Ear Plugs 


Goal 8 hours 
Avoid awakening 8 hrs at night 
Day/Night Cycle, Sleep aid 


Monitoring 
Routine monitoring (Tele, SpO2, RR, NBP) Plus 


Routine 
EtCO,, 
A-Line, +CVP 


Continuous, More #, More Invasive + Routine 
A-Line, CVP, CO/CI+SVR/SVRI, EtCO,, 
Abdominal Pressures, TTE/IVC measurement 


Less, Less Invasive 
Decrease NBP measurements overnight 
Remove Foley 


Rehabilitation 
None or As Able As Tolerated to Maintain or Improve Function Improve Function 
None or ROM/Positioning Q2hrs General Progression: ROM -> Bed-to-Chair Position/Cardiac Chair -> Danlge/Tilt/Stand to March/Walk -> Outside! 
Splinting Splinting Splinting 
Nutrition Id | Feed, | Feed HT] i] If-Feed 
Saree Holding Enteral Fee Enteral Feeds Full Support Full Support Self-Feeding 
Goal: M | f | J 
Se enon a eenvinane Consider TPN Trophic Rate Enteral Enteral and PO including PO and supplements 


supplements 


Fluid Goal 


Goal: Maintain organ perfusion; Avoid volume 
overload 


Targeted Resuscitation/No over resuscitation 
Give fluids only to achieve defined goal 
Lactate decrease by 10% in 4 hrs 

ScvO; > 70%, UOP > 0.5ml/kg/hr 

Blood and Colloids to avoid over resuscitation 


Targeted Management for Euvolemia 
Assess intravascular volume status daily 
Define Goal of Positive, Negative, or even 
Fluid challenge 
Diuretic challenge 


Self-Management of Fluid Balance 
No maintenance fluids 


Access 
Data of insertion Adequate access Balance access & Infection Minimize Infection 
Central line > 3 ports, A-Line 22 Ports Peripheral, 1-2 Ports 
Swan-Ganz Remove arterial line PICC 
Wound Care ; | | 
Perform Daily WC Early with as Daily Showers with wound Care Wound Care Less Often with Simple or 
Many Assistants as Possible and as Many Assistants as Possible Fewer Assisting Self-care 
Medications ee 


Goal: Minimize polypharmacy 


Scheduled + PRN More Enteral/PO Scheduled + More PRN 
More IV + Some Enteral IV PRN More PO 
Some PO Some Enteral 


C. Team View Patient Severity of Illness, Status, and Goals 


Severity of Illness (transfer from scales tool) 


Status 


% Open 


% Feeding Achieved 


Biggest Issue 
Coordinating 
Activities 
See code list behind 
Scales Tool for codes. 


Update Checklist items daily! 


= 
> 
a 


jood ~—CDiiscuss 


GI Prophylaxis C] 
CHG Prophylaxis oO 
HOB > 30 degrees 0 
DVT Prophylaxis LJ 
Last BM < 48 hrs ago 0 
Respiratory Orders Current OU 
Family has questions oO 
Delirium Positive 
Pending Cultures L 


Antibiotic(s) NAO Effective Start Date Planned Stop Date Diagnosis 


OO) O)O/O}O 


OO) 0) 0/0) 0/0/0/0 


Goals (completed during rounds) | Major Goal(s) for next 24-48 hours (*Star Primary Goal*) Priorities of care to achieve these goals 
Fluid volume goal for today: 


Positive 


Negative 


Even 


Dallas Site Tools 
1. Original Team View 
2. Original Scales/Checklist Tool 


Team View Patient Severity of Illness, Status, and Goals 


Severity of Illness (transfer from scales tool) Allergies 


Code Status 


Date| | | | | | | | | | | | 


Status 


% Open 
OR 


Dressings| 
“Down-Day” 


% Feeding 
Central Line 
Arterial Line 
Foley 

BM 


Cultures 


Other Events 
(e.g. family 
meeting, etc.) 


occur and circle planned events 


Place “X” or description where these 


Major Problem List 


Draw Current Wounds Indicate Wound Care 


Antibiotic(s) NAL). Start Date/Stop Date Diagnosis 


Recommendations/Messages 


Goals (completed during rounds) The most important goal(s) for today (what we must do to be successful): _ Priorities: 


Fluid volume goal for today: ___WoundCare ___ Rehab 
L] Positive L ____ Procedure(s) ___ Imaging 
L] Negative L Other 


L] Even= + L 


Tool 1. Patient’s Current Condition 


Instructions: Mark appropriate boxes below. Use the “average” of checked boxes to identify the Illness Severity (summary 
assessment). Transfer global assessment to TeamView and use to identify the appropriate Treatment Checklist. 


Acuity 


Rounds 
Drips 

Labs 
Monitoring 


C1 Worse 
CL] Very Complex 
CL] MD rounding < Q2 hrs! 
O 8-9 Drips 
DO Q4-6 hr labs, > 6/day 
C1 CO Monitoring, EtCO2 


O Standard or Decreasing/Moderate O Minimal/Low Complexity 


OO >>>Getting Better>>>>>>>>>>>>>>>>>>>>>> 


0 2-7 Drips 
Q12-24 hr labs/1-3/day 
Standard ICU (Foley, Tele, SpO2, +/- CVP) 


Oo 
O 


0 Q6-8 hr labs, 4-6/day 
O Arterial Line 


Diagnoses & Problems O Bad O <<< Getting Worse <<< [1] >>>> Getting Better>>> LC Same, Baseline 
Current or Chronic Problems: 
General Condition O Worse >>>>>Getting Better>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>> >>> >>>>>>>>> 
O Baseline, Normal, Can Transfer 
Organ Failures O MODs (2 3 0 1-3 systems 0 1-2 Systems C1 1 System O None or Chronic 
systems) 


Brain, Lungs, Heart, Vascular, 
Bowel, Liver, Kidney, Coagulation, 
Skin 


Step 1 


Organ support is O Active Resuscitation O Increasing in amount or CO Decreasing in amount or number O None 
o Volume Loading number (“Weaning”) 
O Increasing: 
Ventilator, Vasopressors, CRRT 
Medications O More or Increasing O Decreasing 
O Drips/IVs CIV PRN OO PO/Enteral 
Labs/ABG/pH O Frequent labs to monitor O Daily or more frequent LO Daily, less frequent, or PRN labs that are 
XO Acidosis/Shock/Major Derangement labs that show: Normal or Baseline 
L] pH< 7.2, Lactate > 4, SvO2 < 60% DO Acidosis, 
C1 Major e-lyte abnormality (K > 6) O Electrolyte 
abnormality(ies), 
O coagulopathy, 
O anemia, or 
O changing organ 
function (better or 
worse) 
Mechanical O Increasing Support OO CPAP/PS O Decreasing Support 
O High Mean Airway Pressure O Breathing Trials 
Ventilation 
Goal/Plan 
Respiratory Therapy 0 100% FiO2, P:F < 100, 0 70-80% FiO2, P:F 100- 0 40-50% FiO2 P:F >200 CO < 40% FiO2, P:F > 300° 
Fi02/Oxygenation (P:F, Sp02) OO SpO2 < 90 200 OO SpO2 > 90 LC SpO2 Normal or Baseline 
: 0 Sp02>90 
Mental Status O Paralyzed O Diminished O Normal on OO Normal, Baseline 
Vent 
Wounds O Bad 0 Not Bad OO Good 
0 Large/Extensive LC Medium Sized O Small/Minimal 
O Deep burns CJ Mixed Burn Depth O Partial Only 
Rehabilitation Goal/Plan XO None LD ROM>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>> >>> >> >> >>> >> >> D> >>> > >>> >>> >> >> >> >>> >>> >> >>> >> >>> 
L. Sitting>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >>> >> > >>> >>> >>> 
01 Stand/Tilt>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 
0 Walking>>>>>>>>>>>>>>>> 
Risk of Worsening High = All of the Following Medium = Any of the following Low = All of the following 
CO WBC (> 15/rising or < O Febrile XO Normal/Stable WBC 
4/dropping) O Not tolerating LC Normal Temperature 
C1 Hypothermic rehabilitation CJ Normal Vital Signs 
CJ Worsening Mental Status O Increasing Gastric C1 Tolerating feeding 
LJ Increasing HR or RR, or Residuals C1 Stable insulin requirment 
decreasing MAP O Increasing Blood Glucose OC Tolerating rehabilitation 
or Insulin Requireement 
Mier Eh ieltlti(‘i‘“‘“‘“‘“i<i<i<“<“< i 
(summary assessment) Most sick, Least Sick, 


**Copy to the TeamView** 


Potential Demise Could transfer today 


| Step 3. For patients with a Gree 


with a physician as soon as possible (at least during. morning or evening rounds). 


. Review each question. Items that are marked No/Discuss should be discussed 


Analgesia & 
Sedation 


Is the patient interactive/participatory in their care? 


Is the patient awake and participatory in their care? If not, how might you get them so? 


Does the patient have minimal pain? 


Is pain controlled per the patient? 


Is the patient primarily on PO/Enteral pain meds with supplemental IV PRN meds? 


Is the patient on NO sedation? 


Mechanical 
Ventilation 


Is the patient off the ventilator? 


If not off the ventilator, does the patient need a tracheostomy? 


If the patient is not off the ventilator, did he/she receive a breathing trial today? 


If not off the ventilator, is the patient on CPAP and/or did he/she receive a breathing trial 
or trach collar trial? 


What O2 Concentration/Support if applicable? 


Labs 


Is the frequency of all labs daily or none? 


Monitoring 


Is the patient on no more than standard ICU monitoring (Telemetry, SpO2, Foley)? 


Can you reduce NBP measurements overnight? 


Can you remove the Foley? 


Sleep 


Is the patient on schedule to maintain circadian rhythm (Day/Night Cycle)? 


Does he/she need a Sleep Aid? 


How long did this patient sleep? 


Rehabilitation 


Is the patient able to sit and/or stand at the bedside? 


Can you advance the patient’s rehab goal to marching, walking, and possibly going to the 
gym or outside? 


Nutrition 


If not on a PO diet, is he/she on full enteral feeds? 


What is the diet? 


Medications 


Is the patient on PO meds only and possibly some enteral or IV PRN meds? 


Transition 


Is this patient ready to transfer to the ward? 


What needs to be done for the patient in order to transfer him/her to the ward? 


O/OJO;,O;O} O OOO ;O;O;O;O;O;O] U JOs;O/O;O;O;O/O}O]O] yessna 
Ooyoy;oyo); Oo JO;O;O;O;O;O;O ;O;O;) OU (OO), O) 0) 0) 0) 0) 0) 0] no/piscuss 


NA Good Discuss NAGood Discuss 
GI Prophylaxis OO O Respiratory orders current OO O 
DVT Prophylaxis OO O Wound care order current OO O 
CHG Prophylaxis OO O Family has questions O O 
HOB > 30 degrees OO O Delirium Positive O L) 
Last BM<48hrsago LILI O Restraints O i 


Step 3. For patients with a Yellow-Orange Illness Severity. Review each question. Items that are marked No/Discuss should be 


discussed with a physician as soon as possible (at least during morning or evening rounds). 


Analgesia & 
Sedation 


Has the goal of sedation been defined? Arousable or more awake? 


If appropriate, limit sedation to promote ventilator weaning. 


Use APRV, CPAP, or normal tidal volume ventilation if decreasing ventilator support. 


O } O |O} yes/na 
LH |) U |O} No/Discuss 


Use volume or pressure control ventilation if the patient is not weaning or is getting 
worse. 


Consider a daily breathing trial. 


Did the patient receive a daily breathing trial or is one scheduled for today? 


Labs 


Daily labs. 


Is the patient on the correct/best lab frequency? (Q12-24 ABG, CBC, Chem; Q24-QWeek 
LFT, Coag) 


Monitoring 


Is the patient on at least standard ICU monitoring only (Telemetry, SpO2, Foley)? 


Routine ICU Monitoring ( A-Line, EtCO2, Telemetry, SpO2, RR, NBP, +/- CVP) 


Sleep 


Is there a schedule to maintain day/night cycles? 


How long did the patient sleep last night? 


O j;O/;o;O; 08 jo|;oO;O; a 


OyO;O;O; oO /oO;oO;O; a 


Rehabilitation 


Is the patient “tilting” or going to cardiac chair? 


O 
oO 


Consider sitting at bedside. 


Consider standing/marching/or walking if able. 


Consider standing or walking if able. 


Nutrition 


Is the patient achieving “full support” (100% of caloric and protein goals) via enteral 
route? 


If unable to achieve “full support”, consider TPN. 


Medications 


Is the patient receiving mostly IV or Enteral plus IV PRN medications? 


O/}O;} Oo ;O;oO} O 


O/O; oO /O/;oO] a 


NA Good Discuss NAGood Discuss 
GI Prophylaxis OO O Respiratory orders current OO O 
DVT Prophylaxis OO O Wound care order current OO O 
CHG Prophylaxis OO | Family has questions O O 
HOB > 30 degrees OO O Delirium Positive O O 
Last BM<48hrsago LIU EI Restraints O fe} 


Step 3. For patients with a Orange-Red Illness Severity. Review each question. Items that are marked No/Discuss should be 
discussed with a physician as soon as possible (at least during morning or evening rounds). 


|i 
at) 
2\2 
Analgesia & Is the patient on mostly continuous IV analgesia and sedation with additional IV PRN ob 
Sedation medication? 
Is the patient on enough sedation/analgesia to achieve ventilation/oxygenation goals? |O [0 
Is the patient on AC Pressure Control with low tidal volumes or the VDR? oo 
Labs Is the patient on the correct/best lab frequency? (4-6 ABG, VBG/ScvO2, Lactate, CBC, ala 
Chem, Coags; Q12-24 LFT) 
Monitoring The patient should have continuous arterial blood pressure monitoring and continuous no 
cardiac output monitoring. 
Goal is to maximize knowledge: Continuous CO, Arterial Line; Consider abdominal ee 
pressures, ScvO2 monitoring, Echocardiography, IVC ultrasound measurement 
Sleep Consider day/night cycling if able. oo 
Rehabilitation | \s the patient being positioned and receiving ROM therapy at least every 4 hours? oo 
Do not prioritize rehabilitation; prioritize other care first. oo 
Nutrition If shock and holding enteral feeds, consider TPN. op 
Medications This patient should be on continuous, titratable IV medications. a) 
le 


Consider stopping/holding enteral medications. 


NA Good Discuss NAGood_ Discuss 
GI Prophylaxis OO O Respiratory orders current OO O 
DVT Prophylaxis OO O Wound care order current OO Oo 
CHG Prophylaxis OO O Family has questions O Oo 
HOB > 30 degrees OO O Restraints O O 
Last BM<48hrsago LIU O 


